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Applying Positive Discipline in School and Adolescents’ Self-esteem 
Sladana Zukovic", Dusica Stojadinovic' 


‘University of Novi Sad, Faculty of Philosophy, Department of Pedagogy, Serbia, 
e-mail: sladjana.zukovic@ff.uns.ac.rs; dstojadinovic@uns.ac.rs 


Abstract: Starting from the general principles of the concept of positive discipline, the paper points out that schools and 
teachers can significantly contribute to the application of positive discipline to affect different aspects of a student’s personality 
development. The potentials of applying positive discipline in the school for developing adolescents’ self-esteem are particularly 
emphasized. Accordingly, this paper will present the results of a study that aimed to establish a correlation between assessing the 
presence of positive discipline in a school context and the level of adolescents’ self-esteem. The survey included a convenience 
sample of 195 high school students from three high schools - art, technical, and grammar school. The Rosenberg Self-Esteem 
Scale and the scale for assessing the presence of positive discipline in the school were used to collect the data. The results 
showed that adolescents exhibit a high level of self-esteem, while their assessment of the presence of positive discipline in 
school is moderate. Also, it was found that with the increase in the assessment of the presence of positive discipline in school, 
the level of adolescents’ self-esteem increased, and the statistically significant moderating role of the measured variables was 
found only in the type of high school. The conclusion points to the need to sensitize teachers to manage the classroom according 
to the principles of positive discipline, as well as the importance of creating the conditions that, through the phenomenon of 
positive discipline, effectively raise the quality of schoolwork as a whole. 

Keywords: adolescence; positive discipline; self-esteem; school; teachers; students’ social competencies. 


Introduction 


Positive discipline, as an approach to upbringing, is based on the theoretical basis of individual 
psychology, which considers encouragement as a way of developing self-esteem and reinforcing the 
belief that the individuals are good enough just the way they are (Adler, 2009). The essential premise of 
this approach Is based on the belief that, in a relationship with children, nothing can be achieved through 
punishment, threats, and preaching. Instead of this, the child and the adult need to be made aware of 
what doesn’t work in their relationship and how to repair it (Adler, 2009; Nelsen, 1979). Based on this 
belief, as well as on the integration of knowledge about children’s development, children’s rights, and 
effective educational practices, positive discipline becomes a contemporary approach to the upbringing 
that is based on understanding and respecting the personality of the children, individualized approach and 
up-bringing by personal example (Durrant, 2013). This creates the basis for the development of personal 
dignity and self-esteem, respect for other people and respect for their rights, the development of empathy, 
and the application of non-violent communication (Bej, 2016; Durrant, 2013). 

Pointing to the effectiveness of positive discipline in the family and school environment, experts 
(Bej, 2016; Durrant, 2013; Nelsen, 2007) emphasize that positive discipline offers a system of techniques 
that help children/youth develop different social skills sustainable in the long-term, self-discipline, and 
self-confidence when facing real-life situations. It is emphasized that this approach in upbringing and 
education should be applied in interaction with all children/students, and not only with children/students 
who are characterized by challenging behavior. Therefore, the paper starts from the view that, besides the 
family as a basic upbringing factor, the school also represents a very important upbringing environment 
and that teacher as significant another person can significantly contribute to the application of positive 
discipline to affect different domains of student personality development, especially during adolescence. 
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Applying positive discipline in school - the role of teachers 

Considering the assumptions for the application of positive discipline in school practice, experts 
(Bej, 2016; Charles and Senter, 2005) emphasize the importance of creating a climate of respect and 
cooperation that contributes to students perceiving themselves as important and able to control their 
lives, developing self-control, flexibility and, responsibility. Also, the general school/classroom climate 
contributes to the development of a sense of belonging to the school, which increases academic success 
and reduces the risky behaviors of students (Bej, 2016; Uslu and Gizir, 2017). 

One of the key assumptions is the role of the teacher, i.e., their competencies and skills for effective 
application of the principles of positive discipline. Special emphasis Is placed on the ability of teachers to 
control their behavior and reflect on their actions when it comes to upbringing and educational processes 
(Durrant, 2010; Nelsen, 2007). The essence is that teachers express concern for students, and instead 
of misrepresenting the logical consequences of behavior through punishment, involve students in solving 
problems by providing opportunities to see the consequences of their behavior and perceive possible 
solutions (Burden, 2016). 

This mindset and approach to the role of teacher educating are built on four principles: 1) focusing 
on identifying long-term goals; 2) providing warmth and structure; 3) understanding how children/students 
think and feel; 4) problem solving and responding with positive discipline (Durrant, 2013). Before applying 
these principles, teachers must understand them properly and practice their application skills. It is also 
important that when interacting with the student, they think about long-term goals, ways in which the 
student can be provided with warmth and structure, and understand why the student behaves in a certain 
way. The gradual application of these principles can change the way teachers think and act. On the other 
hand, these principles contribute to the students’ acquisition of significant life and social skills (decision- 
making, constructive problem, and conflict resolution, etc.) that will help them become successful members 
of their community (Chadsey and McVittie, 2006; Durrant, 2013; Nelsen, 2006). 

The importance of applying positive discipline for student development is particularly meaningful in 
adolescence when the influence of the relationships that individuals make outside the family is amplified 
(Luciana, 2010). In addition to family and peer group, the school is certainly an environment that has a 
great influence on the development of the individual during adolescence (Oberle, Schonert-Reichl and 
Zumbo, 2011), with one of the key factors in this development being the relation established in relation 
teacher-student/adolescent (Demirdag, 2015). In this regard, UNESCO (2006), following the specificity of 
adolescence, provides some recommendations for teachers to apply positive discipline: 

¢ In the period of early adolescence, the teacher needs to be a role model for mutual respect, 

which implies the absence of preaching and criticism. Also, it is very important to prevent 
potential insults and teasing among the students themselves, so it is recommended that 
students get the opportunity to express their feelings and experiences in different ways. 

¢ In middle adolescence, the recommendations are to encourage students to think creatively and 

critically. Praise and emphasis on positive behavior are desirable, but also setting reasonable 
boundaries and clear rules, and consistency in insisting on respecting the. Teachers are also 
encouraged to share their own beliefs, concerns, and values with students, and to encourage 
them to turn to adults they respect and trust in situations where they need advice. 

¢ In late adolescence, the recommendations are to encourage discussion on various topics and 

respect for the uniqueness of each adolescent, because in this way young people learn to 
respect other people around them, to make decisions independently, and to take responsibility 
for the consequences of their decisions. 

These recommendations on building positive and trust-based relationships between teachers 
and students open up space for learning and constructive problem solving (Charles and Senter, 2005), 
create a sense of safety and belonging (Uslu and Gizir, 2017), and help students/adolescents to accept 
responsibility and take positive control of their behavior in a long-term (Bej, 2016). Such effects are 
certainly an important potential for the development of adolescents’ self-esteem, because, in this period, 
individuals compare their real and ideal selves, and assess their compliance with social standards and 
expectations. 


Potentials of positive discipline in the school for the development of adolescents’ self- 
esteem 

The development of self-esteem is a long-term process, which is influenced by many factors, 
and which goes through periods of decline when moving from one stage of development to another. 
This process continues even more intensely during adolescence (Papalia and Olds, 1995), especially 
given that during this period self-esteem levels vary with a tendency to stabilize (Abdel-Khalek, 2016). 
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Considering that self-esteem involves beliefs about one’s competence, value, and importance, as well as 
emotional states regarding these (Hewitt, 2009), a high level of self-esteem helps adolescents to meet the 
challenges that this turbulent period brings. Therefore, it is very important to keep in mind the potential of 
different educational practices that can contribute to building high self-esteem in adolescents. 

In this context, it can be assumed that positive discipline contributes to the building of a positive self- 
image in adolescents, because, among other things, it implies an individualized approach and reliance on 
the positive in the individual’s personality. However, there is insufficient research to confirm this hypothesis, 
in other words, there are no results of research that could surely confirm the effects of positive discipline 
on the development of self-esteem. One of the key reasons for insufficient empirical confirmation of the 
abovementioned hypothesis can be considered, first of all, through the limitations that the attempt to 
measure a person's self-esteem generally carries with it. Experts (Baumeister et al., 2003) state that the 
main difficulty is that self-esteem is almost exclusively measured by respondents’ self-reporting and the 
fact that there are no objective criteria by which the level of self-esteem that respondents report can be 
compared. The level of self-esteem examined shows how a person views and evaluates himself/herself, 
which does not have to coincide with the real level of self-esteem. However, despite these limitations, 
research into this topic is very valuable, especially when it comes to findings that indicate the potential risks 
of reduced self-esteem. Thus, for example, research has shown that low self-esteem, especially during 
adolescence, can have numerous negative consequences: the appearance of depression (Harter, 1986; 
Rosenberg, 1965), suicide (Kazdin et al., 1983), delinquency (Wells and Rankin, 1983), psychoactive 
substance use (Stacy, Newcomb and Bentler, 1992); low academic achievement (Hawkins, Catalano and 
Miller, 1992; Johnston and O'Malley, 1986). Bearing in mind such findings, it is necessary to prevent their 
occurrence, and the potential benefits of the application of positive discipline during adolescence should 
not be neglected. 

Although examining the effects of applying positive discipline in school is not a widely represented 
area in empirical research, some research has shown that positive changes in students’ behavior (especially 
when it comes to developing self-esteem during adolescence) can be associated with accepting and 
applying certain starting points of a positive discipline in a school context. Namely, numerous studies 
(Furlong et al., 2003; Haynes, Emmons and Ben-Avie, 1997; Osterman 2000; Whitlock 2006) have shown 
that creating positive attitudes and a sense of community in school (as a key starting point for applying 
positive discipline) serve as protective factors that are positively correlated with adolescent self-esteem, 
academic achievement, and school adjustment. Also, research (Deci et al., 1981; Demirdag, 2015; Uslu 
and Gizir, 2017) confirms the importance of the role of teachers in building students’ self-esteem, nurturing 
their independence, and improving their sense of effectiveness in all periods, especially in adolescence. 
Specifically, it was found that students whose teachers show a greater orientation towards supporting 
autonomy and individuality (instead of control) also show a higher level of self-esteem. The potential 
significance of the starting point of positive discipline on the importance of relying on students’ capacities, 
competencies, and talents is supported by research results (Kususanto, Ismail and Jamil, 2010) that 
the teacher's beliefs about students can be manifested through their behavior that students can detect 
and which can afterward lead to either increasing or decreasing students’ motivation and perception of 
personal competence. 

The above findings indicate the importance of research into this topic because, in addition to 
contributing to the understanding of the potential of applying positive discipline for the development of 
student/adolescent self-esteem, they also point to the importance of creating a school ethos that will be 
sensitized to this approach in upbringing. Within this framework, a draft of the research was designed, the 
results of which will be presented in the text below. 


Materials and Methods 


Goals and objectives of the research. The overall goal of the research was to determine the 
correlation between the assessment of the presence of positive discipline in the school context and 
the level of adolescents’ self-esteem. Based on the set goal, the following research objectives were 
formulated: 1. To examine the adolescents’ assessment of the presence of positive discipline in the 
school, and whether there are differences in assessment depending on the gender of the adolescents and 
the type of school; 2. To examine the level of adolescents’ self-esteem, and whether there are differences 
in the level depending on the gender and academic achievement of adolescents; 3. Examine the nature 
of the correlation between the assessment of the presence of positive discipline in school and the level 
of adolescents’ self-esteem, and to what extent the assessment of the presence of positive discipline in 
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school explains the level of adolescents’ self-esteem; 4. Examine the moderating role of gender, high 
school type, and academic achievement in the relationship between assessing the presence of positive 
discipline in school and the level of adolescents’ self-esteem. 

Measurements and variables. Two instruments were used to achieve the set research goal: 

- Rosenberg’s Self-Esteem Scale (RSES) (Rosenberg, 1965), despite general limitations in 
measuring self-esteem, showed high levels of validity and reliability (according to Robins, Hendin and 
Trzesniewski, 2001), which was also confirmed at the sample level in our study (Kronbach’'s alpha is 
.867). The scale has ten items, using a five-point Likert-type scale (from 1- | disagree to 5 - strongly 
agree), which in some earlier studies (Leung, 2011) found very similar basic psychometric characteristics 
as the original four-point scale. 

- The scale for assessing the presence of positive discipline in the school was constructed for this 
research, based on the study of the theoretical basis and characteristics of positive discipline outlined 
by Jane Nelsen (Nelsen, 2007). The scale consisted of ten items that are related to key principles of the 
application of positive discipline by teachers: 1) the principle of focusing on long-term goals in upbringing: 
(Teachers help me to understand the consequences of my behavior and to develop responsibility for 
them; Teachers strive to help me to learn something meaningful for everyday life in each unit; Teachers 
remain consistent and stick to everything they promise); 2) the principle of providing warmth and structure 
(Teachers are interested in my feelings, not just knowledge and school life; teachers are not interested 
to understand explanations and reasons for my actions); 3) the principle of individualized approach and 
reliance on the positive in personality (Teachers praise the effort | put in; Teachers explain each grade they 
give me; Teachers strive to value my knowledge, interest, and commitment that | show); 4) the principle 
of problem-solving and responding with positive discipline (Teachers strive to understand the situation | 
am in or the mistake | make; Teachers are not ready to find a compromise and help to jointly resolve the 
situation or problem | find myself in). The answers were expressed in the form of a five-point Likert-type 
scale (1-never, 2-rarely, 3-sometimes, 4-almost always, 5-always), and the analysis determined that it 
was a one-factor scale showing satisfactory metric characteristics (Kronbach’s aloha amounts to ./88). 

The following variables were used: independent variable (adolescents’ assessment of the presence 
of positive discipline at school); dependent variable (adolescents’ self-esteem); extraneous variables 
(sex, school achievement, high school type). In analyzing the data collected, and to accomplish the set 
objectives, for certain variables (sex, school achievement, and high school type) their moderating role is 
analyzed in the relationship between independent and dependent variables. 

sample and statistical procedures. The study involved 195 high school grade students from three 
high schools in Novi Sad, in the Republic of Serbia. Sample included 97 (49.7%) male and 98 (50.3%) 
female respondents. The number of students from Art highs school we included in this study was 64 
(32.8%), 78 students from grammar school (27.2%), and 53 students from Technical high school (40%). 
When It comes to school achievement the sample consisted of 108 students with excellent (55.4%), 66 
with very good (33.8%), 18 with good (9.2%), and 3 (1.5%) students with sufficient school achievement. 
In the study conducted there were no students with poor academic achievement. 

For the statistical analysis of the data, it was used SPSS package and within it the descriptive 
Statistics procedures (determination of the normality of distribution of the collected data, determination 
of the reliability of the instruments, t-test of independent samples, ANOVA, correlation, regression, and 
moderation PROCESS analysis). 


Results 


The research results will be presented according to the research objectives under the set research 
framework. The first research objective was to determine the presence of positive discipline in school, as 
assessed by adolescents. At the level of the entire scale for assessing the presence of positive discipline, 
the arithmetic mean is 29.94 (min = 12, max = 44). Given that the scale used is not standardized, it is 
not possible to conclude on the level of assessment of the presence of positive discipline. Nevertheless, 
based on the arithmetic value of the scale that is in the second half of the distribution, it can be concluded 
that adolescents evaluate the use of positive discipline as moderately present. The resulting descriptive 
Statistics values for each item are shown in Table 1. 
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Table 1 
The scale of assessment of the presence of positive discipline in schools 
ltem Min Mean lax 
1. Teachers are interested in my feelings, not just knowledge and school 1 1g < 
life. 
2. Teachers make an effort to understand the situation | am in or the mis- 1 2.44 0 
take | make. 
3. Teachers are not interested in the explanation and reasons for my ac- 1 3.03 7 
tions. 
4 Teachers are not ready to find a compromise and jointly resolve a situ- 1 dad < 
ation or problem that | find myself in. 
5. Teachers explain each grade | get. 1 3.30 0 
6. Teachers remain consistent and stick to everything they promise. i o.20 < 
/. Teachers sirive to value my knowledge, interest, and commitment that | i 3.00) 0 
show. 
6. Teachers praise the effort | put in. i 322 o 
9. Teachers help me understand the consequences of my behavior and 1 Pets J 
develop responsibility for them. 
10. Teachers do their best to help me learn something meaningful for eve- 1 3.02 0 


ryday life in each unit. 


In order to examine differences in adolescent's assessment of the presence of positive discipline 
concerning the type of high school, one-factor analysis of variance was conducted (Table 2). The results 
showed that there were no statistically significant differences in the assessment of the presence of positive 
discipline, depending on the type of high school students attend. 


Aphving positive discipline and the type of high school 
N Viean oD F p 
Art school 64 28.92 6.03 
Technical school a 29.13 fi? 1.209 4 
(srammar school 18 30.92 0.06 
Total 195 29 94 6.23 


To examine differences in the assessment of the presence of positive discipline in school concerning 
the sex of adolescents, a t-test of independent samples was conducted. The results obtained (Table 3) 
show that female adolescents are more likely to perceive the presence of positive discipline in school than 
male adolescents, but the difference in assessment is not statistically significant. 


Table 3 
Applying positive discipline and the sex of adolescents 
Dex N Vlean SD t p 
Male Gf 2906 62% 
lying positive discipline in school -1.36 8 ©§©.06 
“pplying P : Female 9 30/1 ~~ 6.11 


The second research objective was to determine adolescents’ self-esteem levels. An arithmetic 
means of 38.07 (min = 14, max = 50) indicates that the adolescents surveyed exhibit a high level of 
self-esteem. By examining differences in adolescents’ self-esteem levels concerning adolescent sex, no 
Statistically significant differences were found (Table 4). 
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Table 4 
Self-esteem and the sex of adolescents 
Sex N Mean oD t p 
Male G7 38.31 8.06 
Self-est | , 
lial Female 99 37.82 779 “3 a 


By examining differences in adolescents’ self-esteem levels concerning school achievement, one- 
factor analysis of variance revealed statistically significant differences (Table 5). The arithmetic means 
values indicate that adolescents with better school achievement also exhibit higher levels of self-esteem. 


Table 5 
Self-esteem and adolescents’ school achievement 
N AS SD F p 

Sufficient 3 26.606 5.50 
Good 18 35.88 9.30 
Very good 66 37.00 8.34 tte ve 
Excellent 108 39.35 1.16 
Total 195 38.07 7.91 


The third research objective was to examine the correlation between assessing the presence of 
positive discipline in school and adolescent's self-esteem. To this end, the Pearson linear correlation 
coefficient was applied, and the values obtained are shown in Table 6. 


focus between applying positive discipline in schools and the adolescents’ self-esteem 
Applying positive discipline Adolescents 
in schools sel-esteem : 
Applying positive discipline in schools i ae 00 
Adolescents’ seli-esteem 32 1 | 


The statistical analysis conducted confirmed the existence of a statistically significant and positive 
correlation between the assessment of the presence of positive discipline in school and the level of 
adolescents’ self-esteem. The results show that with the increase in the assessment of the presence of 
positive discipline at school, the level of adolescents’ self-esteem also increases. 

To see the extent to which the assessment of the presence of positive discipline at school explains 
the level of adolescents’ self-esteem, a regression was performed (Table 7). The assessment of the 
presence of positive discipline in school was found to explain 9.8% of the adolescent self-esteem variable. 


Table 7 
Regression — the extent to which the assessment of the presence of positive discipline at school 
explains the level of adolescents’ self-esteem 


R R2 Kor. R? p 


Applying of positive discipline in schools S12 096 093 00 


The fourth research objective was to determine the moderating role of sex, school achievement, 
and type of high school. Therefore, process analysis of the interaction of these variables, and their impact 
on the relationship between the assessment of the presence of positive discipline in school and the level 
of adolescents’ self-esteem was made. A model that included a variable for assessing the presence of 
positive discipline in school and adolescents’ sex turned out to be statistically significant (F (3, 191) = 7.33; 
p <0.01; R2 = .10). Regarding the moderator role of sex, no statistical significance was found (b = 5.36; 
t (191) = -.46; p = .64). A model that included a variable for assessing the presence of positive discipline 
in school and adolescents’ school achievement turned out to be statistically significant (F (3, 191) = 9.19; 
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p <0.01; R2 = .12) but no statistical significance was found in examining the moderating role of school 
achievement (b = 6.15; t (191) = 1.91; p = 0.056). A model that included the positive discipline presence 
assessment variable and high school type proved to be statistically significant (F (3, 191) = 10.16; p <0.01; 
R2 = .13). In examining the moderator role of the high school type, statistical significance was found (b= 
8.17; t (191) = 2.48; p = 0.01). Table 8 shows the results of the moderator role concerning the type of high 
school. 


Table 8 
Moderator role of the type of high school 
b 52 t p LLC ULCI 
Art school 60 as 4 32 00 3275 8770 
Technical school ok 08 4 32 00 2031 5432 
Grammar school 4 ale 1.05 24 -.1260 4140 


An insight into Table 8 shows that a statistically significant moderating role of the assessment of 
the application of positive discipline exists in art and technical school. It can also be observed that with 
the increase of one unit of assessment of the presence of positive discipline in art school, adolescents’ 
self-esteem increases by .60, and that with the increase of one unit of assessment of the presence of 
positive discipline in technical school adolescents’ self-esteem increases by .37. grammar school students 
showed that a higher assessment of the presence of positive discipline was not statistically significant for 
the change in adolescents’ self-esteem. 


Discussion 


Based on the results of the adolescent assessment of the presence of positive discipline in school, 
it is possible to see that items related to the application of the principles of positive discipline (such as 
consistency and focus on problem-solving, reliance on positive and long-term goals) are assessed at a 
high level. On the other hand, adolescents believe that respect for desires and feelings, i.e., providing 
warmth and structure as an important principle of applying positive discipline in the school context, 
is the least present. Although in the relevant literature (Nelsen, 2007) the individualized approach is 
emphasized as a key aspect of positive discipline, the findings obtained at the level of our sample show 
that it is the least present. The importance of applying an individualized approach, especially when 
working with adolescents, is emphasized by the results of other research (Ames and Miller, 1994; Deci 
et al., 1982; Demirdag, 2015) which indicate that teachers who know each of their students, respect their 
needs, support their autonomy, value and respect their personality as a whole, and positively influence 
the intrinsic motivation and self-esteem of students. Also, research (Deci et al., 1982; Demirdag, 2015) 
has shown that controlling behavior in relationships with students, i.e., the authoritarian approach as a 
classroom management strategy, has a limited positive impact on adolescent personality. In line with the 
above, the findings obtained at the level of our sample may indicate a tendency for teachers to practice 
a more directive style of communication, which contradicts the basic postulates of positive discipline 
and individualized approach, which include non-directive communication style, and the use of praise, 
encouragement, and acceptance of students’ ideas. 

When it comes to the type of school, the results showed that adolescents surveyed in all three 
high schools evaluate the application of positive discipline at a similar level. This result may indicate that, 
regardless of the type of high school, teachers prefer a certain style of behavior and form of communication 
that may be in a certain relationship with a more or less assessed level of application of positive discipline. 
Therefore, a proposal for further research would be to analyze the relationship that exists between teacher 
behavior styles and the level of application of positive discipline. Also, the obtained findings indicate an 
equally important need to improve the pedagogical competencies of teachers in both grammar school and 
secondary vocational schools. 

When It comes to the results related to the self-esteem variable, it was shown that the examined 
adolescents express a high level of self-esteem. This finding can be related to the tendency of self-esteem 
to stabilize in this period, which Rosenberg confirmed in his research (according to Tashakkori et al., 
1990). The relevant literature (Dumont and Provost, 1999; Tashakkori et al., 1990) points out that the 
presence of high levels of adolescent self-esteem can be associated with a more positive interpretation of 
everyday circumstances, changes, and stress that adolescents face in this unstable period of development 
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but also with experiencing more positive situations and experiences in everyday life. Interestingly, some 
researchers (Thorne and Michaelieu, 1996) found a difference in the level of self-esteem of adolescents in 
favor of male adolescents, which they explained by the premise that self-esteem in adolescence is based 
primarily on perceptions of the individual about his/her body and appearance, which have in mind the 
social pressures and the image of the woman that exists in modern society, as well as the faster physical 
maturation of adolescents, can cause lower levels of self-esteem in female adolescents. Similarly, other 
researchers (Robins et al., 2002; Zeigler-Hill and Myers, 2012) have pointed to differences in self- 
esteem in favor of male adolescents, and that this difference remains noticeable during early and middle 
adolescence, after which decreases and disappears at a later age. The results of our study showed 
results in self-esteem in favor of male adolescents, but not at a statistically significant level, which may be 
due to a small sample of respondents. 

The analysis related to determining the differences in the level of self-esteem of adolescents 
concerning school achievement showed that adolescents with better school achievement also express a 
higher level of self-esteem. However, this result should be taken with a reservation, having in mind the uneven 
distribution of the sample according to school success, but also the difficulties in clearly understanding the 
cause-and-effect relations of these two variables. Namely, numerous studies (Baumeister et al., 2003) 
have confirmed a positive correlation between school achievement and self-esteem, but at different levels 
of strength. Some authors (Hansford and Hattie, 1982) found that there was a statistically significant and 
positive correlation between school achievement and self-esteem, and regression found that self-esteem 
explains between 4% and 7% of the school achievement variable. Also, research (Baumeister et al., 
2003; Manning, 2007) has found that better school achievement leads to higher levels of self-esteem, ie 
that high self-esteem is the result, not the cause of good school achievement. All the above points to a 
positive correlation between these two variables, but also to their complex and ambivalent relationship, 
which makes it more difficult to interpret the research results more precisely. 

When it comes to examining the relationship between the predictor and criterion variable, it was 
found that with the increase of assessment of the presence of positive discipline, the adolescent's self- 
esteem potentially grows. This is supported by the results of previous research (Demirdag, 2015) which 
showed that if teachers set high expectations, rely on the positive in adolescence, are focused on long- 
term goals, and are consistent in their actions, can positively affect adolescents’ self-esteem. The claims 
related to these aspects of the application of positive discipline in school were the ones that were assessed 
as the most present by the surveyed adolescents. 

By applying process analysis, a statistically significant moderator role of the high school type was 
found. An interesting finding is that in secondary vocational schools it has been shown that adolescents’ 
self-esteem grows if the assessment of the presence of positive discipline also grows. On the other 
hand, the respondents from grammar high school showed stability of self-esteem, regardless of the 
assessment of the presence of positive discipline. This situation may be a consequence of the already 
built experience of academic self-efficacy in grammar high school students, which is also reflected in their 
experience of self-worth (Gutvajn and Dzinovic, 2019). In any case, the obtained findings imply the need 
for further research on the relationship between the specifics of the school environment (dimensions of 
school climate, educational style of teachers) and personal characteristics of students (personality traits, 
academic self-concept, goal orientation, etc.) that may be important for their self-esteem development. 


Limitations and recommendations for further research 

Although the findings provide a good starting point for considering the possibility of improving 
positive discipline in schools in Serbia, it is important to mention the limitations of the research as well as 
recommendations for further research on this topic. The key limitation refers to the sample of respondents 
because It is a convenient sample that prevents the generalization of the results of the research to a wider 
population of students. Another limitation regarding the sample of respondents is the inhomogeneous 
distribution of respondents concerning school achievement, and because of that the results of the analysis 
according to this variable must be taken with a reservation. Also, it is necessary to keep in mind that in this 
research, only the perspective of adolescents Is presented, which can make it difficult to draw conclusions 
about the real representation of positive discipline in schools. Accordingly, future research on this topic 
should include teachers’ perspectives on the importance and effects of applying positive discipline, as well 
as their self-assessment of dominant educational procedures and classroom management strategies. 
In addition to all the above, in further research on this topic, it would be desirable to apply some other 
research methods (such as systematic observation, interviewing, focus group examination) that would 
provide a more accurate image of the researched subject. 


www.ljcrsee.com 


Zukovic, S. & Stojadinovic, D. (2021). Applying positive discipline in school and adolescents’ self-esteem, /nternational Journal 
of Cognitive Research in Science, Engineering and Education (IJCRSEE), 9(1), 1-11. 


Conclusion 


Generally speaking, the results of the presented research point to the conclusion that the application 
of positive discipline in the school environment can be viewed as a significant potential for strengthening the 
self-esteem of students/adolescents. On the other hand, we should not ignore the finding that, according 
to the respondents, teachers insufficiently apply the principles of the individualized approach, providing 
warmth and structure, as well as relying on the positive in the personality of students. In this sense, the 
key practical implication of the findings relates to the need for teachers to master strategies for effective 
classroom management (Demirdag, 2015; Uslu and Gizir, 2017), because such teacher competencies 
are important for the effective application of positive discipline, and therefore for the development of 
adolescent self-esteem. 

It is also important to emphasize that the potential benefits of applying positive discipline for the 
development of students ‘/ adolescents’ self-esteem should be viewed as an important resource for 
preventing various forms of undesirable behavior and thus for creating school as a safe environment 
(McVittie, 2003; Osher et al., 2010). Particular emphasis is placed on the positive effects of combining two 
approaches to improving school discipline - Support for Positive School Behavior (SBPBC) which aims 
to develop a student behavior management system and Social-Emotional Learning (SEL) which aims to 
develop resources for student self-discipline (according to Osher et al., 2010). Although these approaches 
differ in their primary goals, what they have in common is that they are aimed at preventing problematic 
behavior and promoting students’ social competencies. 

Given that self-esteem Is a significant protective factor in preventing antisocial behaviors (Dobrescu, 
2013), the school’s task is to allow each student to develop their potential and grow up in a climate of 
appreciation and respect (Bej, 2016; Gutvajn and Dzinovic, 2019). Therefore, it would be desirable to 
focus on the development of professional competencies, not only teachers but also all actors in school 
life, in order to create conditions to effectively raise the quality of schoolwork as a whole through the 
phenomenon of positive discipline. Finally, the importance of family/parent involvement should not be 
left out (McVittie, 2003; Uslu and Gizir, 2017), as well as the importance of harmonizing parenting style 
and teaching style (Paulson, Marchant, and Rothlisberg, 1998), having in mind that an authoritative style 
Is recommended as a starting point for effective applying positive discipline in both family and school 
(Nelsen, 2006). In that sense, it is very important to nurture such a cooperative relationship between 
families and schools that will contribute to the application of the principles of positive discipline in both 
developmental environments to maintain continuity in educational procedures towards children/students. 
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Abstract: The aim of this study is to examine the cognitive flexibility before and during the COVID-19 pandemic through 
a different performance measurement suitable for online application. In the study, three different data collected in 2019 (119), 
2020 (120) and 2021 (121) were compared with both within-and between-subject designs. One-hundred-and-twenty-three 
university students were included in the study for within-subjects, 239 for between-subject. According to the findings of the study, 
the cognitive flexibility of the students who continue formal education in T19 is higher than the students who continue distance 
education in T20 according to both within-subject and between-subject design. Besides, in both designs, fewer total words 
were produced in I19 than in T20. The sentences created by the students who continue their distance education in pandemic 
stay around less categories and contain more words. According to the within-subject findings obtained at T20 and 121, the 
cognitive flexibility and total words produced at T20 were greater. In other words, the scores of the students decreased over 
time during the pandemic period. In 121, cognitive flexibility is not related to vulnerability, perceived risk, and fear of COVID-19. 
However, according to the regression results, vulnerability at T21 was predicted by the total word and total emotional word in 
T20. Accordingly, producing more total words in T20 reduced vulnerability in T21; however, using more emotional words in T20 
increased vulnerability in T21. In addition, the number of siblings was negatively associated with vulnerability. Lastly, cognitive 
flexibility test was found to be reliable. 

Keywords: cognitive flexibility, performance measurement, emotional word, COVID-19, vulnerability, fear, perceived risk. 


Introduction 


Cognitive flexibility enables individuals to follow and succeed in complex tasks, and to adapt 
to changing demands. Besides, it is an important characteristic that depends on the interaction of 
sensorimotor and various cognitive mechanisms (lonescu, 2012). Cognitive flexibility is defined as the 
cognitive ability to switch between two different concepts and to think about different concepts at the 
same time (Scott, 1962). Therefore, cognitive flexibility is an executive function that involves shifting 
attention to another set (e.g., Lehto et al., 2003). Also, cognitive flexibility is defined as “the ability to 
benefit from different categories, the number of different categories used” in performance measures (€.g., 
Rietzschel, De Dreu and Nijstad 2007; Murray et. al, 1990). On the other hand, cognitive flexibility also 
reflects the revealing of unique semantic relationships (Jung-Beeman et al., 2004). Cognitive flexibility 
is a more complex process than a simple response shifting (Whiting et al., 2017). Neuroimaging studies 
have shown that when the language component is added to cognitive flexibility, more brain regions are 
activated in a complex manner. This is a complex process in which processing speed, working memory, 
and language processes have shared neural substrates with the frontal, parietal, and temporal regions of 
the brain (Barbey, Colom and Grafmanet, 2013). 

The concept of cognitive flexibility is more evidence-based and larger than psychological flexibility 
(Whiting et al., 2017). Abstract definitions of psychological flexibility and cognitive flexibility are similar, but 
the functional goals of the concept of cognitive flexibility have reduced it to a shift setting (lonescu, 2012). 
Both concepts include a behavioural change as an intellectual or movement towards environmental 
changes. The significant difference between the two concepts is the role of the self and acceptance in the 
context. Accordingly, while cognitive flexibility includes adapting to changing cues, psychological flexibility 
includes seeing oneself apart from experiences and emotions and being able to accept these experiences 
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instead of behavioural change and experiential avoidance when necessary (Whiting et al., 2017). 

While psychological flexibility enables individuals to adapt to variable conditions, it also requires 
changing the behavioural repertoire when necessary (Kashdan and Rottenberg, 2010). It has been shown 
in different contexts that psychological flexibility is an important variable in maintaining mental health, 
and the lack of psychological flexibility in many psychopathology situations (Bond and Flaxman, 2006; 
Ciarrochi, Bilich and Godsellet, 2010; Kashdan and Rottenberg, 2010; McCracken and Morley, 2014). 
In times of such intense COVID-19 pandemic, both psychological and cognitive flexibility emerge as 
important concepts (e.g., Dawson and Golijani-Moghaddam, 2020; Fernandez Lynch et al., 2020; Kroska 
et al., 2020; Pakenham et al., 2020). Psychological flexibility has been shown to be effective in moderating 
the potentially harmful effects of COVID-19 risk factors (Pakenham et al., 2020). Besides, psychological 
flexibility is positively associated with well-being. It has been shown to be negatively associated with anxiety, 
depression, and distress related to COVID-19 (Dawson and Golijani-Moghaddam, 2020). Openness to 
experience, behavioural awareness, and valued action, which are components of psychological flexibility, 
might be important targets in intervention and prevention regarding COVID-19 (Kroska et al., 2020). 

Apart from this, there are fewer studies in the context of cognitive flexibility than the concept of 
psychological flexibility. Jafari (2020) revealed that the self-reported cognitive flexibility taken with the 
Cognitive Flexibility Inventory was negatively correlated with anxiety during the COVID-19 period, and 
that the control sub-dimension of cognitive flexibility was negatively correlated with risk perception. 
Afshari, Hashemikamangar and Hashemikamangar (2021) found that both the control and alternatives 
sub-dimensions of cognitive flexibility are negatively correlated with the risk perception of COVID-19. 
Cognitive flexibility was found to have a negative correlation with social-distance fatigue, and a positive 
correlation with compliance with social distance (Seiter and Curran, 2021). Further, cognitive flexibility of 
COVID-19 patients who responded to home treatment was found to be significantly higher than those who 
did not respond to treatment (Jafari, 2020). As a result of these findings, it is understood that cognitive 
flexibility is an important variable in coping with COVID-19. However, all the studies presented here took 
measures of cognitive flexibility via self-report. In a period where cognitive flexibility is so important, it Is 
crucial to conduct a study in which performance measurement Is taken. 

The current study examines cognitive flexibility in the context of students. The distance education 
process has started to take place in our lives more than ever due to COVID-19, and distance education 
has become inevitable due to current conditions (Kim, 2020). The pandemic has caused a global crisis 
in higher education (Raaper and Brown, 2020). According to Aucejo et al., (2020), 13% of students 
post-poned their graduation due to COVID-19, 40% lost their jobs, internships or job offers, and 29% 
expect less earnings by the age of 35. Chen, Kaczmarek and Ohyamaet (2020) shows that according 
to the perception of a significant majority of students, burnout in distance education has increased and 
engagement in lessons has decreased. Fifteen percent of medical students are concerned that the 
pandemic will affect their specialty choices (Byrnes et al., 2020). Chinese students studying overseas 
Stated that they have anxiety largely stemming from media discrimination and fear of COVID-19 (Ma and 
Miller, 2020). Besides these effects of the pandemic on students’ academic and daily lives, there are also 
partially positive effects due to the transition to distance education. For example, students have faced 
many difficulties, their engagement has decreased, and their learning opportunities have been damaged, 
but there are also positive effects such as students’ ability to attend classes in their location and flexibility 
in learning processes (Hill and Fitzgerald, 2020). Again, due to COVID-19, while 25% of students’ study 
hours increased by more than 4 hours per week, another 25% decreased by more than 5 hours per week 
(Aucejo et al., 2020). It is conceivable that COVID-19 reduces students’ motivation, disrupts their daily 
routines, and reduces coping strategies required to deal with stressors (Grubic Badovinac and Johri, 
2020). Therefore, it is important to study on and develop solutions for possible effects. In this context, it 
becomes important to understand the role of cognitive flexibility. 

To measure cognitive flexibility, many methods have been used previously, including self-report 
and performance measurement. Some of the methods used in the performance measures of cognitive 
flexibility are Alternative Uses Test (AUT; Guilford, 1967), Torrance Creativity Test (TTCT; Almedia et al., 
2008) and Wisconsin Card Sorting Test (WCST; Kongs et al., 2000). Cognitive flexibility is considered as 
a sub-dimension in creativity tests such as AUT and TTCT. Cognitive Flexibility Inventory (CFI; Dennis, 
and Vander Wal, 2010) and Cognitive Flexibility Scale (CFS; Bilgin, 2009) are among the most used 
scales in self-report measurement of cognitive flexibility. Studies investigating the relations of cognitive 
flexibility between self-report and performance measurement show that the correlation between self- 
report and performance measures is either weak or absent, so it is suggested that neither measure the 
same structures or cognitive processes (Johnco, Wuthrich and Rapee, 2014). While problems such as 
social desirability (Webster, 2019) may arise in self-report measurements, a more reductionist approach 
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is used in performance measures, so both approaches have their own advantages and disadvantages. 
Nevertheless, it is suggested that these two different approaches complement each other (Synder, 
Friedman and Hankin, 2020). ; 

As a result, a different approach, used in Cambaz and Unal’s study (2021) and suitable for online 
application in this pandemic period, is used in the performance measurement of cognitive flexibility in 
this study. Like Barbey, Colom and Grafman (2013), this performance measurement includes processes 
to produce language. It is planned to compare this measurement taken at different times in university 
students, before and during the pandemic period, within-subject and between-subjects. Finally, it is 
aimed to examine the relationship of this cognitive flexibility with vulnerability, perceived risk, and fear in 
COVID-19. 


Hypotheses 

Hypothesis 1 (H1): The cognitive flexibility (H1) and the total number of words produced (H1V2) of 
students at time 119 are expected to be higher than the levels of students at time 120. 

Hypothesis 2 (H2): The cognitive flexibility (H2V1) and the total number of words produced (H2V2) 
measurements taken from the same students at T20 time are expected to be higher than the students at 
T21 time. 

Hypothesis 3 (H3): There will be a negative relationship between cognitive flexibility and vulnerability, 
perceived risk and fear regarding COVID-19. 


Materials and Methods 


Participants 

The data was collected at three different times (i.e., 2019, 2020, and 2021) from 239 students (207 
women (86.6%), for details see Table 1) studying at a state university in Ankara, Turkey. Ethical approval 
of the study was obtained from Ethics Committee. Participants were invited to the study in return for 
additional points for the course. 


Table 1 
Number of participants 
Design 

Year Between-subject Within-Subject 

2019 100 16 

2020 139 123 

2021 - 123 

Total: 239 Total:123 

Design 


Dependent variable 
Cognitive flexibility and produced total words (collected in 119, 120, and 121), and vulnerability, 
perceived risk, and fear of COVID-19 (collected only in T21) were the dependent variables of the study. 


Independent variables 

Within-Subject. Pre-pandemic (119), pandemic (T20) and second pandemic (121) data obtained 
from the same participants at different times were compared. The within-subject results were obtained by 
comparing 119 with 120, and 120 with 121. 

Between-Subjects. Before and after pandemic: 2 (scores before pandemic [119] x scores during 
pandemic [T20]) 
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Measurements 
Cognitive flexibility task 


The performance measurement in Cambaz and Unal’s (2021) study was used for assessing 
cognitive flexibility. The operational definition of cognitive flexibility in this measure Is “the ability to benefit 
from different categories, the number of different categories used, revealing unique semantic relationships” 
(e.g., Jung-Beeman et al., 2004; Murray et. al, 1990; Rietzschel, De Dreu and Nijstadet, 2007). A total 
of 40 words from 8 different categories (e.g., school, furniture, emotions), 5 from each category (e.g., 
student, desk, happy), were presented in a table. The categories used in the table are predetermined 
and the words from these categories presented as mixed in this table. Thus, an objective approach was 
demonstrated in determining the different categories used by the participants. The instruction given to the 
participants Is “Please form five different sentences using at least one of the above words, or as many as 
you want.” The cognitive flexibility score of the participants was obtained through the following formula. 


5 
> kn =! 


n=1 
k = number of different categories used in a sentence 


Using one category in a sentence does not generate points because the participants have already 
been asked to use at least one word. For example, “! feel unhappy.” cognitive flexibility score was 
considered 0 for the sentence. Because in this sentence, only one word from one category was used, 
and the instructions given to the participants were already stated for them to use at least one word. All 
participants, without exception, used at least one word in each sentence. For instance, considering the 
sentence “The cat and dog were playing happily.”, three different words from two different categories are 
used and the cognitive flexibility score for this sentence is 1. Words belonging to the same category used 
in the same sentence do not produce cognitive flexibility scores. Cognitive flexibility score was calculated 
as “the number of different categories used in a sentence — 1” within this framework. The total score is 
obtained by adding the flexibility score generated for all sentences. As a result, cognitive flexibility here is 
not the use of a word given in the table in a sentence, but the ability of the participants to combine words 
in different categories, which are more difficult to use together. 


COVID-19 vulnerability, perceived risk, and fear 

As in Yildirim, Geger and Akgul’s (2021) study, vulnerability, perceived risk, and fear measure- 
ments were also collected. For vulnerability, the following question was asked to the participants: “In your 
opinion, what Is the probability of developing coronavirus disease during the coronavirus outbreak?”. For 
perceived risk, the participants asked the following question: “Compared to most people your age and 
sex, what would you say your chances are for developing novel coronavirus?”. Lastly, “| am afraid of novel 
coronavirus” and “I am terrified by a novel coronavirus” was used for fear measurement. All questions 
were 5-point Likert type, and high scoring for each question indicated higher vulnerability, higher perceived 
risk, and higher fear, respectively. 


Procedure 

Participants were invited to the research via the online form. Participants who approved the consent 
form first answered the cognitive flexibility task, then the COVID-19 questions (T21) and the demographic 
form (119, T20). 


Results 


Reliability of the Measurement 

To test the reliability of cognitive flexibility for five different sentences in the 119 data, the Cronbach 
aloha internal consistency coefficient was examined. The result was .78. The internal consistency 
coefficient was found as ./7 and ./73 for the T20 and 121, respectively. To measure the test-retest reliability, 
the correlation between T20 and 121 data from the same participants was examined. Accordingly, the 
test-retest correlation coefficient was found to be .64. 
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Within-Subject Results 

The analysis of the data was performed by using the SPSS v23 statistical analysis program. Below 
and above 2.5 standard deviations were excluded from the analysis. Paired-sample t-test analysis’ results 
indicated a significant difference in the cognitive flexibility scores between T20 measurement (M = 3.96, 
SD = 2.82) and the 121 measurement (M = 3.31, SD = 2.55) conditions; t (123) = 3.17, p = .00. There was 
a significant difference in the total words scores for between T20 measurement (M = 41.87, SD = 9.77) 
and the T21 measurement (M = 39.02, SD = 7.75) conditions; t (123) = 3.54, p < .001. 

There was a difference between the cognitive flexibility scores for between 119 measurement (M = 
5.00, SD = 1.91) and T20 measurement (M = 4.43, SD = 2.71) for same participants (t (13) =1.10, p=.29) 
was not significant. However, the total words’ scores for 119 measurement (M = 32.86, SD = 11.65) and for 
T20 measurement (M = 46.21, SD = 10.37) for same participants (t (13) = 4.13, p < .001) was significant. 


Between-Subjects Results 

The MANOVA test was applied to examine the cognitive flexibility and total word differences of 
different students whose data were collected at 119 and T20 (gender and age were controlled). According 
to Box’s Covariance Equality Test results (F (3, 3431724) = 2.01, p =.11), it was found that the covariance 
equality assumption was met. According to Levene’s Equality of Variance Test results, it was found that 
the equality of variance assumption was met for cognitive flexibility F (1, 237) = ,007, p = .94) and total 
words (F (1, 237) = .38, p = .54). 

The different measurement times (T19-T20) had a significant effect in multivariate test (A = .819, 
F (2, 234) = 25.84. Namely, 119 measurement of cognitive flexibility (N = 99, M =4 .97, SD = 3.01) was 
significantly higher than T20 measurement (N = 140, M = 3.76, SD = 2.66); F (1, 235) = 10.10, p = .00, 
n27 = .04. Also, T19 measurement of total words (N = 99, M =3 4.51, SD=8.99) was significantly lower 
than T20 measurement (N=140, M=41.89, SD = 9.83); F (1, 235) = 34.10, p = .00, n27 = .12. In other 
words, students who continued their education with formal education in 2019 used significantly more 


categories (their flexibility was higher) but they used significantly less words. Gender and age did not 
Cause a significant difference. 


Correlations Among Variables 

There is a correlation of .64 between 120 and 121 time of cognitive flexibility, and a correlation 
of .52 between 120 and 121 times of the total word (see Table 2). There is a correlation of .37 between 
vulnerability and perceived risk; .23 between vulnerability and cognitive flexibility in T20; -.23 between 
vulnerability and the total words in T20; and .23 between vulnerability total emotional words in T20. No 
correlation was found for cognitive flexibility and total word data at T21 time obtained simultaneously with 


COVID-19 related variables. To examine how the data explains vulnerability, regression analysis was 
performed. 


Table 2 
Correlation coefficients 
{ 2 3 4 5 606 OT g 9g 10 11 12 
1.CF-T20 { 
2.CF-T21 64 1 
3 TW-120 08 -05 1 
4 TW-T21 08 00 52" 1 


9. TEW-120 50" 30 16° 04 1 
6. TEW-121 2" AM -OF -04 39 1 
{Vulnerability 23° 13 -23" -10 23 08 1 


8. P. Risk -04 -04 -20 -09 -03 O09 37" 1 

9. Fear -10 -03 -1f -02 -14 -04 11 141 

1). FP SEL -06 -09 -12 -16 -03 17 -05 -01 05 { 

11. Siblings -01 -06 04 04 O04 -01 10 -03 -25"% -16 1 

12. Age -06 -05 -08 -16 -08 -04 13 O11 03 -10 02 1 


** o9=0.01.*. p< 0.05, CF = cognitive flexibility, T20 = 2020 data, T21 = 2021 data, TW = total word, TEW = total emotional 


word, P. Risk = perceived risk, fear, P. SEL = perceived socioeconomic level 
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Regression for COVID-19 Vulnerability 

The model in Table 3 explains 31% of the vulnerability variance, F (11,112) = 4.67, p = .00 (see Table 
3). Accordingly, the perceived risk (6 = .348, t = 4.28, p = .00) predicts vulnerability. Cognitive flexibility, 
total word, and total emotional words obtained at the same time (in 121) with the perceived risk variable 
did not predict vulnerability. Surprisingly, the total word (8 = -.22, t = -2.311, p = .02) and total emotional 
words (8 = .24, t = 2.48, p = .02) obtained from the same participants a month ago (in 120) predicts 
vulnerability. In other words, performance measurements taken from the participants simultaneously 
with the vulnerability measurement did not predict vulnerability. Performance measurements (total word 
and total emotional word) collected a month ago predicted vulnerability. Accordingly, while the total word 
collected three weeks ago seems to decrease the upcoming perceived vulnerability, the total emotional 
word used a month ago seems to increase vulnerability. 


Table 3 
The model for vulnerability of COVID-19 
step 1 Step 2 step 3 step 4 
B AR? AF B AR? AF B AR? AF B AR? AF 
Sex 12 05 1.89 10 15 10.80* Tt O16) 86 08 11 574 
Age 14 ‘At ‘At Bs Fa 
Siblings  .09 st2 ‘AN a3 
Fear 08 06 jA0 
P. Risk Bi is of go: 
CF T?1 13 --04 
TW T21 01 10 
TEW 121 -.01 -.08 
CF 120 18 
TW 120 -.22" 
TEW 120 25° 


* p «0.05, P Risk = perceived risk, CF = cognitive Flexibility, TW = total word, TEW = total emotional word, T20 = 2020 data, T21 = 2021 data 


Discussion 


In this study, a performance measure was used benefiting from the language production processes 
of cognitive flexibility. This performance measure is also in line with the definition of cognitive flexibility 
regarding usage of unique semantic relationships (Jung-Beeman et al., 2004). It is understood that this 
performance measurement, suitable for online application during this pandemic period, gives reliable 
results. According to Hulin, Netemeyer and Cudeck (2001), 0.6-0.7 levels are acceptable, so although it 
is a performance measurement, it is understood that the internal consistency coefficient and test-retest 
coefficient are sufficiently reliable. This test-retest coefficient is even higher than the Turkish version of 
the Cognitive Flexibility Inventory (Gulum and Dag, 2012), which is a self-report measure. Some of the 
disadvantages mentioned about performance measures are that they require a lot of time and money and 
their investment in maximal performance in the artificial environment (Coman and Richardson, 2006). 
However, the current proposed measurement lacks these disadvantages and participants do not have to 
strain for a maximum performance. So, the flexibility score also depends on a desire that the participants 
are not aware of. In creativity tests such as AUT and TTCT, the responses of the participants are obtained 
first, and then the coders try to obtain how many different categories those answers belong to, and with a 
relatively subjective approach. In this proposed method, the cognitive flexibility score is evaluated within 
the framework of objective criteria in the sentences. 

According to the between-subject findings of the study, the cognitive flexibility of students who 
continue formal education in 2019 (119) is higher than that of students who continue distance education 
in 2020 (120), thus H1V1 is confirmed. However, the total words produced by students attending formal 
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education in 2019 is lower than the students who continue distance education in 2020, thus H1V2 is 
confirmed just the opposite way. In other words, while students in 2019 formed sentences with fewer 
words around more categories, students in 2020 formed more words with less categories. This finding 
was confirmed by the within-subject results comparing the 119 and T20 results, where a limited participant 
was available. In 119 time, the participants produced sentences with fewer words around more categories, 
compared to the 120. Both within-subject and between-subject research results reveal a pattern like this: 
students who continued their distance education during the pandemic period used more words around 
fewer categories, that is, they were stuck around certain categories. This could be considered as a 
reflection of less cognitive flexibility. 

According to the within-subject findings at T20 and T21 times, students produced more cognitive 
flexibility and total words at T20 than at 121, thus H2V1 and H2V2 is confirmed. One reason for the 
cognitive flexibility and total word in 120 time is higher than at T21 time may be that the approaching 
exams in T21 time plays a role as a stressor, since high anxiety is associated with low cognitive flexibility 
(e.g., Kalia, Knauft and Hayatbiniet 2020; Park and Moghaddam, 2017; Yu, Yu and Lin, 2020). Exam 
anxiety during the pandemic period may have caused worse results. Although the data were collected at 
the same time, no correlation was found between the cognitive flexibility, total word, total emotional used, 
and COVID-19 variables at T21 time, thus H3 is not confirmed. Also, no correlation was found between 
perceived risk of COVID-19 and self-reported overall cognitive flexibility (Kalia, Knauft and Hayatbiniet 
2020). Surprisingly, however, regression analysis revealed that vulnerability in T21 was predicted by 
the total word and total emotional word in T20. The high number of total words in T20 time decreased 
vulnerability, and the high number of total emotional words in T20 time increased vulnerability in 121. 
This may mean that expressing ourselves during the pandemic period reduces our vulnerability, but when 
emotional expression is involved, our vulnerability increases. The study also found that the number of 
siblings was negatively correlated with the fear of COVID-19. According to the findings of Ma and Miller 
(2020), perceived social support in students during the pandemic period is negatively related to anxiety 
and stress. Greater number of siblings may be related with greater perceived social support. 

Cognitive flexibility is associated with positive outcomes during the pandemic period (e.g., Afshari, 
Hashemikamangar and Hashemikamangar, 2021; Kalia, Knauft and Hayatbiniet 2020; Seiter and Curran, 
2021). In the current study, obviously, distance education period plays an important role in reducing 
students’ cognitive flexibility. In addition, stressors such as exam stress could further reduce cognitive 
flexibility. If conditions such as the loss of a relative are added to this picture, it may be even more 
difficult to cope with this situation. Therefore, some strategies should be followed to increase the cognitive 
flexibility of students and make them to adapt to the distance education process in a better way. 

The first strategy may be as follows: Social interactions of individuals -within the scope of pandemic 
possibilities- allow healthy progress. In the current study, it has been shown that the number of siblings 
is negatively related to the perceived fear of COVID-19. In addition, the vulnerability of the participants 
who expressed themselves more (producing more total words) after one month was found to be lower. 
However, the vulnerability of the participants who expressed themselves around emotional words was 
higher after one month. Therefore, it seems important to provide environments where participants can 
express themselves without experiencing excessive emotional intensity. In this period, students’ access 
to mental health services should be facilitated, albeit virtual, and social assistance should be provided 
to students in special situations (Liu et al., 2020). Online education is proposed to include planning, 
implementation and reflection stages and there are tasks to be completed in these stages (Kim, 2020). 
Kim suggests that even if the transition to normal classroom teaching is difficult in the current situation, 
the environment, and activities like the classroom environment should be provided in online teaching and 
important components such as creativity, critical thinking, and communication should be presented to 
students. Students may have some suggestions to make the lessons more efficient (Chen, Kaczmarek 
and Ohyama, 2020). Working with small groups of previously distributed cases could be more beneficial 
for students than lecture alone. Interactive lessons are also more beneficial and ungraded quizzes can 
be made useful at this stage so that students can be integrated into the lesson. Interactive teaching style 
is the main predictor of student satisfaction and effectiveness of teaching (Fatani, 2020). Students may 
improve their metacognitive skills (e.g., cognitive flexibility) to better adapt to education in COVID-19 
(Qadir and AlFugaha, 2020). Qadir and Al-Fugaha suggest that it may be beneficial for students to have 
a basic knowledge on the functioning of memory, the connection of neurons with each other, how to learn 
best and how to consolidate information to improve their meta-cognitive processes. 

One limitation of this study is the small number of participants for the within-subject design at 
T19 and 120 time. In addition, the proposed novel method needs to be studied in different contexts and 
variables. Not only the quantity but also the quality of the sentences produced by the participants around 
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certain words may provide meaningful data. Different qualitative structures may occur in the content 
of sentences according to the number of different categories used. Therefore, qualitative analysis and 
semantical evaluation of the generated sentences might provide new perspectives. Also, for future studies, 
it may be suggested to investigate the relationship between different performance measures of cognitive 
flexibility and the currently proposed performance measurement. While distance education extended the 
study time of some students, it decreased some, as well (Aucejo, 2020). Examining personality types of 
participants (e.g., extroverted, or introverted) might help to explain these seemingly contradictory results. 


Conclusion 


In this study, a novel approach was used to measure cognitive flexibility. The correlation between 
the measurements collected at different times points to a disposition, which could be called as trait, for 
the number of word production and the use of words from different categories. As a result, in a period 
when the COVID-19 pandemic was experienced so intensively, students seem to get heavily affected both 
cognitively and emotionally. Current research reveals that cognitive flexibility, which is a metacognitive 
process, is affected by this process, as well. Accordingly, in this period, students preferred to produce many 
words around fewer categories, indicating low cognitive flexibility, rather than producing their semantic 
resources efficiently. However, performance measures such as producing many words or focusing on 
emotional words as a general dispositional strategy have also been found to predict future vulnerability 
to COVID-19. More research is needed to examine important psychological resources such as cognitive 
flexibility that may be affected by this period, and to develop strategies to protect these resources. 
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Abstract: For pupils to obtain high-quality and permanent knowledge, it is important that the teaching of scientific 
and technical contents is based on cognitive constructivist approach. We carried out a research, during which we asked three 
research questions, on a sample of 167 class teachers in the Republic of Slovenia. We wanted to find out: how often class 
teachers included elements typical of cognitive constructivist approach; was the frequency of using elements of cognitive 
constructivist teaching model linked to the teacher's concern for their own professional development, and was the frequency 
of using elements of cognitive constructivist teaching model linked to the factors, such as the teacher's estimated importance, 
difficulty and necessity of Science and Technics, the assessment of their own competence and professional enthusiasm. Data 
were collected with three scales: ways of teaching scientific and technical contents; attitude to scientific and technical contents 
and teaching and components of professional development. Data were processed according to descriptive and inferential 
Statistics. The research showed that the formulation and verification of hypotheses, two important elements in view of cognitive 
constructivist teaching model, were less often represented. With statistically significant higher frequency they were organized 
by teachers, who rated their competence higher, were more enthusiastic and cared more about their professional development. 

Keywords: cognitive constructivist teaching model, science and technics, competence, professional enthusiasm, 
professional development. 


Introduction 


In today’s highly developed technological world, in the time of fast and unpredictable technological 
changes, a relevant technological competence is of fundamental importance for people. Social and 
economic changes challenge expert consideration on the importance of technology and the ways of 
education that will, along the entire vertical of national school systems: from pre-school to post-graduate 
education, enable its achievement. It is important to achieve technological literacy in each individual. 

Johnson (1989) defines Technology as “the application of knowledge, tools, and skills to solve 
practical problems and extend human capabilities” (0.13), and states that it is enhanced by the discoveries 
of science and shaped by the designs of engineering. When defining technology, various researchers 
(McRobbie, Ginns, and Stein, 2000; Gardner, Penna, and Brass, 1996; Johnson, 1989; Jones and Carr, 
1992) point out the following: a) technology is a process; b) it has a human dimension; c) technology Is 
situated (it is conducted within contexts and constraints); d) it includes a social dimension; and (e) it leads 
to the development of products or artefacts. 

For quality teaching of contents related to natural sciences and technology it is essential for 
teachers to have in-depth knowledge of technology that encompasses all of the five dimensions; while 
also their conceptions are important. 

Research has shown that teachers’ beliefs are a strong determinant of teachers’ behaviour. 
Teachers’ perceptions of subject discipline and their conceptions of teacher and student role have an 
important impact on the teachers’ decision-making and teaching (Steh Kure, 1999; Valenéié Zuljan, 2007; 
Tigchelaar, Brouwer, and Vermunt, 2010). For example, a teacher who saw himself as the guardian of 
conventional wisdom in science adopted a transmission model of teaching in the classroom and talked 
about imparting a desired amount of knowledge (McRobbie and Tobin, 1995, as cited in McRobbie, Ginns, 
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McRobbie, Ginns, and Stein, 2000). 

For quality teaching of scientific and technical contents, teachers’ didactic competencies are 
essential. In their review of several studies on learning and meta-studies on teaching efficiency, Dumont 
and Istance (2013) emphasize how important it is to form efficient and innovative learning environments. 

Characteristics of efficient learning environments are: a) in such environments the teacher knows 
each individual student and performs differentiation and individualization; b) such environments promote 
optimal mental and emotional activity in each pupil: c) they create collaborative learning and collaborative 
climate; d) they promote innovativeness and openness and include authentic problems and different 
ways of research; e) they promote learning of learning and conceive the independence of pupils (Valencic 
Zuljan, 2016). 

The formation of efficient and innovative learning environments requires professional and well 
considered selection and complementation of various didactic strategies, teaching methods and ways 
of working. In their meta-analysis of effective teaching, Marzano, Pickering, and Pollock (2006) refer to 
the ways of working that have a significant impact on pupils’ achievements. They highlight pupil-centred 
strategies, such as Summarizing, taking notes, cooperative learning, setting goals and giving feedback, 
formulating and testing hypotheses, asking questions and giving cues. Combining various teaching 
methods and forms of learning to reach predefined goals enables the individualization of learning process, 
.e., adapting classes to different pupils (Mattes, 2007; Strmcnik, 2001; Blazic et al., 2003; Plesec Gasparic 
and Valencic Zuljan, 2019; Valencic Zuljan and Kalin, 2020). It is a complex and important competence 
that develops, according to research findings, during higher stages of teachers’ professional development 
(van der Lans, van de Grift, and van Veen, 2017; Pecar, 2018). 

In reference to either earlier studies of ‘teacher effectiveness’ school or more recent international 
comparative studies, numerous researchers are pointing at the effectiveness of direct instruction or whole 
class teaching (Rosenshine, 1979; Reynolds and Farrell, 1996; Miao et al., 2015; Hattie, 2009, 2018; 
Muijs and Reynolds, 2002). Muijs and Reynolds (2017) define direct instruction as the way of work where 
the teacher conveys learning contents directly through teaching the whole class, while they point out 
that this is not only frontal teaching, but also constant autonomous learning work which plays a key role 
in pupils’ effective learning and knowledge. In this context, Valencic Zuljan and Kalin (2020) use the 
term traditional teaching (as opposed to open teaching), as they want to emphasize it is classical from 
the historical point of view, and as they also want to point out the quality of this way of work in attaining 
certain educational goals. Traditional teaching has proved to be effective to obtain basic knowledge, 
skills and rules (Brophy and Good, 1986; Good and Brophy, 2003), but less so to acquire more complex 
and creative contents where the didactic strategies of open teaching are more effective. The term open 
teaching has been introduced by Strmcnik (2001). Valenci¢ Zuljan and Kalin (2020) define the term 
more in detail. They perceive openness from several points of view: openness to recognize and take 
into account different characteristics of pupils; openness when looking for optimum in terms of pupils’ 
characteristics and teaching contents; openness in the use of sources and spaces; teaching not only 
in school premises and classrooms but also outside (field work, excursions, outdoor teaching, learning 
through project work, pupils’ research work, authentic learning); openness regarding the cooperation of 
various profiles of educators and other experts (team teaching, cooperation with researchers, artists, 
cultural creators, scientists, etc.), openness of the teacher's and pupil's roles (flexible alternating of direct 
and indirect teaching, teachers can also assume more of a mentor’s role, pupils can engage in peer 
teaching) etc.... and also openness in combining didactic strategies. In order to achieve technological 
literacy in each pupil, it is thus important for the teacher to make, while taking account of learning goals 
and contents as well as pupils’ characteristics, a professionally well considered selection and combination 
of didactic strategies (project and problem teaching, problem and traditional teaching, etc.) and to form 
encouraging and innovative learning environment. As exposed by Vujicic, Pejic-Papak, and Valencic- 
Zuljan (2020, p. 29) “Effective learning setting requires a meaningful combination of individual, frontal 
and group learning forms, inter-twining pupils’ independent work with group work, team cooperation 
among teachers and other professionals, establishing partner relationship between school and broader 
environment’. When teaching scientific and technical contents, the experientially oriented instruction has 
an important role. According to Blazic et al. (2003), it has a long tradition, since it was highlighted by 
educators who derived from empiricism and sensualism (such as Comenius), and educators who relied 
on rationalism. According to Marks and Walter (1981, as cited in Marenti¢ Pozarnik, 1987), the basic 
premise of experiential learning is that we learn the best when we do something ourselves. Kolb (1984), 
who developed the experiential learning model, defines the experiential learning as every learning where 
pupils are in direct contact with reality they study. He emphasizes that this is learning as ‘the process 
whereby knowledge is created through the transformation of experience. Knowledge results from the 
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combination of grasping and transforming experience’ (Kolb, 1984, p. 41). “This process is portrayed as 
an idealized learning cycle or spiral where the learner ‘touches all the bases’ — experiencing, reflecting, 
thinking, and acting” (Kolb and Kolb, 2009, p. 44). Various studies on the effects of experientially oriented 
learning in Science and Technics were carried out at various levels of schooling (Abdulwahed and Nagy, 
2009; Dzan et al., 2015; Crompton, 2020; Cotic et al., 2020). Cotic et al. (2020) examined the effect of an 
experiential learning model (The Mobile Natural Science Learning - MNSL) on the knowledge of 4th grade 
primary school students in Slovenia, during natural science school lessons at the seashore through the 
use of tablets. Mobile technology provides authentic learning, assisting outdoor lessons providing material 
and environmental context in learning, which support the experience of a learner. Findings indicate that 
the MNSL-model had a positive effect on students’ achievement in science, more precisely in knowledge 
on marine organisms and life at the seashore. 

several researchers studied the impact of instructional methods on students’ attitudes toward 
technology and knowledge (Boser, Palmer, and Daugherty, 1998; Lin et al., 2020). In further text we refer 
to the examples of studies that in various ways emphasize the importance of connecting various didactic 
strategies and learning methods. 

For the development of scientific and technological literacy it is crucial that learners (children and 
young people) get familiar with basic scientific and technical conceptions, support them with facts and 
connect them in a network of knowledge. 

In teaching, the explanation method significantly contributes to the clarity and systematic nature 
of basic conceptions and rules, and the conversation and discussion methods of teaching help verify 
student's understanding, putting the contents in different perspectives, opening unsolved questions 
(Valencic Zuljan and Kalin, 2020), while including inter-subject connections. When teaching scientific 
and technical contents, drawing and modelling are also important (Valencic Zuljan and Kalin, 2020; 
Anning, 1997; Hallstrom, Elvstrand, and Hellberg, 2015). Mawson (2010) found that opportunities for 
pupils to draw as a form of technical activity are lacking. As he exposes, learning various techniques 
of drawing and modelling would enable students to obtain technical language useful to express their 
ideas. Teaching methods of written works and of work with texts are also important in achieving scientific 
and technical literacy. Ritchie, Tomas, and Tones (2011) refer to the importance of pupils’ activity and 
creativity in writing and reading. Several researchers (Hand and Prain, 1995, as cited in Ritchie, Tomas, 
and Tones, 2011; Prain and Hand, 1996, 1999, as cited in Ritchie, Tomas, and Tones, 2011), found that 
diversified writing tasks, including more imaginative writing, have been shown to assist students’ learning 
processes, improve learning outcomes, have strong motivating effects, and impact positively on students’ 
attitudes and engagement. In this context, the use of student-generated narratives is important. While 
narrative writing is not traditionally connected to teaching Science and Technics, it attracts pupils and has 
encouraging effect on them. Wellington and Osborne (2001, as cited in Ritchie, Tomas, and Tones, 2011) 
think that it helps children express their thoughts in written language through being personally engaged 
(p. 76), it also offers opportunities to connect personal experiences with science ideas (Hand et al., 2001, 
as Cited in Ritchie, Tomas, and Tones, 2011; Hodson, 2009, as cited in Ritchie, Tomas, and Tones, 2011). 
Moreover, Avraamidou and Osborne (2009) seriously reflect on the question: How can the conceptual 
complexity of scientific information be translated into ‘everyday’ language without minimizing its value? 
A challenge for teachers, according to Vosniadou et al. (2001) should be the creation of interesting and 
challenging learning environments where teachers will encourage students to actively participate and 
direct themselves towards their own goals, building and nurturing the students’ natural desire to explore. 
Mihalicek (2011) states that encouraging learning environment and the use of modern didactic strategies 
contribute not only to the quality of teaching, but also to the satisfaction of pupils and their teacher. He 
exposes it as an important teacher’s competence. 

McRobbie, Ginns, and Stein (2000) emphasize that teachers should be able to plan and implement 
learning experiences that would engage students in the generation and evaluation of ideas, and the use 
and evaluation of design practices to construct a technological artefact. Despite the importance attributed 
to the teaching method for practical work, activities and products, when pupils make artefacts, get to 
know various materials and acquire skills within the framework of technology education, the education 
process should not remain at that level only. Mawson (2007) points that in teaching Science and Technics 
great emphasis is on making artefacts, while the discussions on broader questions regarding the nature 
of technology and connections between technology and society are less frequent. (Mawson, 2010, p. 10) 
The latter is particularly important for the development of pupils’ technology literacy. 

Twyford and Jarvinen (2000) point at the value of problem teaching that “brings authenticity to 
classroom experiences for pupils”. Technological problem solving is a form of reflective thinking in which 
the child interacts with many sources of knowledge in the process of solving a problem. The pupil's mind 
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changes and develops through active participation. 

When teaching scientific and technical activities, particularly in younger pupils, the play-based 
learning method is also important. Boser, Palmer and Daugherty (1998) and Wolters (1989) found the 
greatest impact on developing a positive attitude toward technology was playing with technological toys, 
such as LEGOs, Tinkertoys, and Erector Sets. 

Turja, Endepohls-Ulpe and Chatoney (2009) have established that not many studies research the 
play-based method in the context of technological education. When teaching scientific and technical 
contents to younger pupils, it is possible to apply role playing in various contents: pupils meet various 
professions, through play, they can get experiences on objects, materials and physical phenomena, through 
research and tasks, they learn to use tools and accessories (Turja, Endepohls-Ulpe and Chatoney, 2009). 
There can be individual or group play, which can be (psychomotor) skill-oriented or creative, focused on 
problem solving etc. Parker-Rees (1997) believes there are structural similarities between free play and 
design and technological activities, their common feature being encouraging creativity and critical thinking 
in problem solving. Play can contribute to language development and connecting abstract concepts and 
ideas with technological objects that are used during play. Free play can stimulate the ability to visualize 
or a certain kind of cognitive modelling, important in designing and technological activities (Parker-Rees, 
1997). 

The organization of cognitive-constructivist model of teaching is essential for quality when teaching 
sciences and technical contents (Yager, 1991; Valencic¢ Zuljan, 2002, Orbanic Dolenc, Dimec and Cencic, 
2016; Akcay and Yager, 2010; Twyford and Jarvinen, 2000; Fox-Turnbull and Snape, 2011). Several 
Studies have shown that cognitive-constructivist model of teaching improves the students’ learning 
outcomes (Kim, 2005; CGalik et al., 2007; Cakici and Yavuz, 2010; Orbanic Dolenc, Dimec and Cencic, 
2016) and increases students’ interest for science (Parker and Gerber, 2000). 

Constructivist views are based on the research performed by many authors, such as Piaget, 
Vygotsky, Dewey (Marenti¢ Pozarnik, 2018). Piaget mostly derived from processes that a person uses 
to construct the understanding of the world; while Vygotsky - the founder of social constructivism, rather 
emphasizes the importance of dialogue in knowledge building (Marenti¢ Pozarnik and Cencic, 2003). 
In spite of different views constructivist-oriented researchers have, they share their emphasizing that 
individuals actively constructs their cognitive structures, when interpreting their own experiences in 
particular situations (Palincsar, 1998) or that learning means an active mental process, in which pupils 
themselves transform information into meaningful knowledge (Phillips, 1995). The teachers’ role is to 
design a complex, challenging learning environment with original authentic tasks (Muijs and Reynolds, 
2017), and to encourage and accept student autonomy (Moustafa, Ben-Zvi-Assaraf and Eshach, 2013). 

It is pupil-oriented teaching (Valencic¢ Zuljan, 2002; Wilen, Hutchison and Ishler, 2008; Muijs and 
Reynolds, 2017) that emphasizes the importance of didactic principle of activity and individualization. 
Therefore, teachers should know children’s concepts and experiences in addition to wrong and incomplete 
perceptions and consider them within the learning process. A teacher forms situations of socio-cognitive 
conflict and in the process of modelling offers children suitable support in solving the conflict. The teacher's 
support in cognitive conflict resolution and in the whole process of learning is very important (Valencic 
Zuljan, 2002; Manentic Pozarnik and Cencic, 2003). For quality learning, children should be able to acquire 
the knowledge according to different ways and various activities in a stimulating and innovative learning 
environment with a proper balance between individual and group work, research and discovering, and the 
teacher’s systematic guidance and moderating (Barron and Darling-Hammond, 2013). 


Materials and Methods 


Deriving from the meaning of cognitive-constructivist teaching model (Yager, 1991; Akcay and 
Yager, 2010; Valencic Zuljan, 2002; Marentic Pozarnik, 2004, 2018; Marentic Pozarnik and Cencic, 2003: 
Gojkov, 2009) and various studies on technological education (Mawson, 2007, 2010, 2013; Fleer, 2000; 
Stables, 1997; Hallstrom, Elvstrand and Hellberg, 2015), we wanted to know to which extent class teachers 
include elements of cognitive-constructivist model when teaching scientific and technical contents. 

Deriving from the research problem, we formed three research questions: 

1. When teaching scientific and technical contents, how often do class teachers introduce elements 
of cognitive-constructivist model? 

2. Is the frequency of implementing elements of cognitive-constructivist teaching model connected 
to the teachers’ concern about their own professional development? 

3. Is the frequency of implementing elements of cognitive-constructivist teaching model connected 
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to the following factors: The importance of scientific and technical contents; Need for Science and 
Technics education; Competence for quality teaching in Science and Technics; Professional enthusiasm, 
and Complexity of teaching Science and Technics. 

In our research, we used quantitative research approach and descriptive and causal non- 
experimental method of educational research. 

The research included 167 class teachers from various primary schools in the Republic of Slovenia. 
Data were collected with three scales: a) ways of teaching scientific and technical contents; b) attitude to 
scientific and technical contents and teaching; c) components of professional development. We used the 
instrument, developed in the project “Culture of Educational Institution as a Factor in Co-Construction of 
Knowledge,” and adapted it to our needs. 10 new statements were added to the scale Ways of teaching 
scientific and technical contents that was developed in the project and originally had 6 items. A factor 
analysis was carried out and Cronbach's reliability coefficients calculated for the new 16 item scale. 
The Cronbach's alpha reliability coefficients are as follows: the first factor (Importance of scientific and 
technical contents) .792; the second factor (Need for scientific and technical education) .798; the third 
factor (Competence for quality scientific and technical education) .674, the fourth factor (Professional 
enthusiasm) ./19; and the fifth factor (Difficulty of teaching Science and Technics) .502. 

Data were processed according to descriptive and inferential statistics. The data were processed in 
the IBM SPSS Statistics Version 27 statistical package. Correlation coefficients ( P ) and factor analysis 
were used. 

Factor analysis was carried out on the scale Attitude towards scientific and technical contents and 
teaching, consisting of 16 statements. The statements were abstracted into substantively five meaningful 
factors (KMO = 0.799; Bartlett's test of Chi-Square sphericity = 927.435 with p = .000). The method of 
factor extraction “Principal Component Analysis” was selected. The method of factor rotation is “Varimax 
with Kaiser Normalisation”. The reliability coefficient of this scale is Cronbach's alpha .850. Table 1 
presents eigenvalues, explained variances and the number of factors obtained. Table 2 presents the 
matrix of factors (a set of factors). 


Table 1 
Eigenvalues, explained variances and the number of factors obtained 


Initial Eigenvalues Extraction Sums of Squared Loadings 


Component 
Total ‘%of Variance Cumulative % Total % of Variance Cumulative % 

1 Bid 32.693 32.693 9.231 32.693 32.693 
2 1.f2f 10.796 43.490 Ei2Zt 10.796 43.490 
3 1.415 8.843 52.532 1.415 8.843 92.332 
4 1.112 6.952 59.284 MP 6.952 99.284 
3 1.057 6.609 65.893 1.057 6.609 65.893 
6 0.868 9.428 11.321 

t 0.775 4.844 76.164 

8 0.671 4.196 80.360 

9 0.594 3.714 84.075 

10 0.565 as ki 87.605 

11 0.439 2.142 90.348 

12 0.414 2.986 92.933 

13 0.345 2.154 95.088 

14 0.322 2.014 97.102 

15 0.258 1.614 98.716 

16 0.206 1.284 100.000 
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Table 2 
Matrix of factors (set of factors) 


Factors: 
Vanables = 


Natural and technical sciences are the basis of social development and 


0.850 

DPOOrESS. 
Sonety progress is based on research in natural and technical sciernc- 0.823 
eS. 
lf a child | sful in learning, it | sible to guide them toward 

a child is sits u m earning, it is sensible to guide them towards 644 0.458 
natural and technical sciences. 
Th | of ing in natural and technical sc is t ich gen- 

2 goal of engaging in natural and technical sciences is to enrich gen 0548 0357 0308 


eral Auman culture. 


Natural saences and technology in primary school are needed to ena- 


0.795 
ble pupils to decide on their further education. 
Sci d Techni stb ted in pri hool educati 
clence an nics must be represented in primary-school education 0654 0595 
as early as possible. 
Scientific and technical content indi able f ils’ full devel- 
clentific and technical contents are indispensable for pupils eve 0642 0544 


opment 
Education in scientific and technical domains is needed to increase 


Q.307 0.598 0.337 


OWS engagement in solving technology problems of modem society. 

| have enough knowledge to prowde pupils quality support in tiem re- 

search and operation of scientic and technical projects within the con- 622 
text of teaching. 

In my view, | can properly assist pupils who cannot find a solution when 0768 
solving saence tasks. 

[do fine when | lead discussions related to scientific and technical con- 

tents. 

lam fond of teaching Science and Technics. 0.601 
| can motivate pupils for scientific and technical contents. 398 0.654 


0.526 


In ony Wew, scientific and technical contents are demanding for teach- 0782 


nq. 


Teaching scientific and technical contents is demanding because of 0770 
additional space and matenal requiremerits. ; 


Teachers who lack 2 ith teach genthe and technical = 
eachers wha expenences with teaching scientific and technica 0319 0358 0.395 


contents should receive additonal training in this domain. 
Note: Extraction method: Principal Component Analysis. Rotaton method: Varimac with Kaeser Normalization. 
The table shows only values above (2. Factor loadings are bold. 


Descriptions of factors obtained 

Factor 1 - entitled Importance of scientific and technical contents explains 32.693% variance of 
factor space. Factor 2 - entitled Need for scientific and technical education explains 10.796% of total 
variance. Factor 3 - entitled Competence for quality scientific and technical education explains 8.843% 
of total variance. Factor 4 - entitled Professional enthusiasm explains 6.952% of total variance. Factor 
5 - entitled Difficulty of teaching Science and Technics explains 6.609% of total variance. 
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Results 


Frequency of implementing various elements of cognitive constructivist way of teaching 
scientific and technical contents 

Teachers assessed 6 statements that defined elements of cognitive constructivist way of teaching 
scientific and technical contents. Since the cognitive constructivist way of teaching points out mental 
activities of pupils, all the statements were designed so that they originated in the descriptions deriving 
from pupils’ activities. 

When forming individual statements we relied on various descriptions of cognitive constructivist 
model (Sparks-Langer et.al., 2000; Valencic Zuljan, 2002), that emphasize the importance of pupils’ 
activities in collecting information to test hypotheses, in reflective observation and asking questions, 
formation of hypotheses, performance of various experiments, verification of hypotheses, as well as the 
analysis and generalization of conclusions. 


Table 3 
The shares of assessed frequency of implementing various elements in teaching scientific and 
technical contents 


1 2 3 - 5 

statement: | never | rarely | do at | offen | do very M 
PUPILS do do times do often 50 
1. Perceive phenomena and ask ques- f 1 Z 30 95 Ay 40? 
tions. F (30) 0.6 1.2 17.8 06.2 243 0.72 
2. Collect information with research f Z if 06 90 14 3.63 
Pern Sk (a) 42 44 33.1 53.3 83 0.74 
3. Formulate assumptions (hypotheses) f 3 61 ot 1? 1 3.63 
on possible answers to questions or so- F(a) 
REET RTE aa 36.1 47.4 10.1 0.6 0.74 
4 Examine assumptions f = Be Og 24 2 3.91 

F (30) 24 20.7 08.6 17.2 1.2 0.68 
9. Carry out expernments. f 1 f 43 at Jf 3.66 

F (90) 0.6 41 25.4 47.9 219 0.82 
6. Analyze obtained results and draw f 3 44 of ot 1 3.94 
conclusions. F (90) 1.8 24.3 01.5 219 0.6 O73 


The table 3 shows that in no item grade 5 appears in the first position - | do very often (regularly), 
somewhat higher rate appears in items Pupils perceive phenomena and ask questions (24.3%) and 
Pupils carry out experiments (21.9%).Grade 4 — | do often appears in the first position / with the highest 
share in three items: Pupils perceive phenomena and ask questions (56.2%), Pupils collect information 
with research problem tasks (53.0%) and Pupils carry out experiments (47.9%). Grade 3 — | do at times 
figures first in three items: Pupils formulate assumptions (hypotheses) on possible answers to questions 
or solutions to problems (47.9%); Pupils examine assumptions (58.6%), and Pupils analyze obtained 
results and draw conclusions (51.5%). Grade 2 —| do rarely has a somewhat higher share in three items: 
Pupils formulate assumptions (hypotheses) on possible answers to questions or solutions to problem 
(36.1%); Pupils examine assumptions (20.7%), and Pupils analyze obtained results and draw conclusions 
(24.3%). 


Is the frequency of implementing various elements of cognitive-constructivist way of 
teaching scientific and technical contents connected to teachers’ concern of their own professional 
development? 

We wanted to know whether the frequency of implementing various elements of cognitive- 
constructivist way of teaching scientific and technical contents was connected to the teachers’ concern 
of their own professional development, and this was covered in two items: using new scientific research 
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findings in the domain of learning, teaching and other subject matter and reflecting on their own pedagogical 


practice. 


Table 4 


Assessing items on teachers’ concern of their own professional development 


Statement 


In my work, | use new scientific f 
research findings from the domains 
of learning, teaching and other 
subject matter. 

| regularly reflect on my own f 
pedagogical practice. 


f (%) 


f (%) 


1 ? 3 4 o 
Nottyp  Mostlynot | cannot Mostly Absolutely M 
cal at all typical Say typical typical SD 
1 9 30 109 19 3.80 
0.6 J.3 17.8 64.5 11.2 0/2 
1 g AY 99 2? 3./6 
0.6 J.3 243 06.2 13.0 0./6 


In both items grade 4 occupies the largest share (Table 4) — Mostly typical 64.5% of teachers 
estimate to be “mostly” typical for them to use new scientific research findings from the domains of 
learning, teaching and other subject matter, and 56.2% to be mostly typical for them to regularly reflect on 
their own pedagogical practice. Grade 5 - absolutely typical with its share of 11.2% appears for item “In 
my work, | use new scientific research findings from the domains of learning, teaching and other subject 
matter’ and with 24.3% share for the statement | regularly reflect on my own pedagogical practice. 


Table 5 


Correlation coefficient ( P ) between the teacher’s concern for their own professional development 
and the frequency of implementing various ways of teaching scientific and technical contents 


Elements: PUPILS 


1. Perceive phenomena and ask ques- 
tions 


2. Collect information with research prob- 


lem tasks 


3. Formulate assumptions (hypotheses) 
on possible answers to questions or solu- 
tions to problems 


4 Examine assumptions 


5. Carry out experiments 


6. Analyze obtained results and draw 


conclusions. 


a Bae Os a sa 


= 2 VDVlI=Le2 5 Viz 3°0U VizU TJS 3b VSS 3S TF 


Using new findings Reflecting on their own practice 


181° .222"* 
O19 004 
16/ 168 
106 .218** 
AT2 004 
16/ 168 
080 251** 
306 001 
166 16/ 
197° .213** 
O11 006 
165 166 
A153 093 
049 AS. 
16/ 168 
244" 151 
002 Qo2 
166 1o/ 


Teachers who regularly reflect on their own pedagogical practice, statistically significantly more often 
organize classes, where pupils perceive phenomena and ask questions (p = .004): collect information with 


30 


www.ljcrsee.com 


Zuljan, D., Valenci¢ Z. M., & Pejic P. P. (2021). Cognitive constructivist way of teaching scientific and technical contents, 
International Journal of Cognitive Research in Science, Engineering and Education (IJCRSEE), 9(1), 23-36 . 


research problem tasks (p = .004:; formulate assumptions (hypotheses) on possible answers to questions 
or solutions to problems (p = .001); and examine assumptions (p = .006). Teachers who teach using new 
scientific research findings from the domains of learning, teaching and other subject matter, statistically 
significantly more often organize classes, where pupils perceive phenomena and ask questions (p = 
.019):examine assumptions (p = .011); carry out experiments (p = .049): and analyze obtained results and 
draw conclusions (p = .002) (Table 5). 


Correlations between factors and the frequency of implementing various elements of 
cognitive constructivist way of teaching scientific and technical contents 

We were interested whether factors Importance of scientific and technical contents (factor 1); Need 
for scientific and technical education (factor 2); Competence for quality scientific and technical education 
(factor 3); Professional enthusiasm (factor 4), and Difficulty of teaching Science and Technics (factor 5) 
are statistically significantly connected to the frequency of implementing various elements of cognitive 
constructivist way of teaching. 


Table 6 
Correlation coefficients ( P ) between factors and the frequency of implementing various ways of 
teaching scientific and technical contents 


Factor: 
Elements: PUPILS | 2 3 4 ) 
p  -.089 0o4 251" 200° 130 
1. Perceive phenomena and ask questions p 2d AIS 001 O10 O98 
N 163 163 163 163 163 
2. Collect information with research prob- p 038 ‘17 290" 129 030 
lem tasks p 633 136 000 O99 05 
N 163 163 163 163 163 
3. Formulate assumptions (hypotheses) on p —_—--004 010 250" 131 Of4 
possible answers to questions or solutions p S62 895 001 O98 34f 
to problems N 162 162 162 1b? 1b? 
0 021 a5 210° 196° 266" 
4 Examine assumptions p £95 Ths O07 O13 O01 
N 161 161 161 161 161 
p 109 -017 188" 291" 110 
5. Carry out experiments p 165 827 016 O00 161 
N 163 163 163 163 163 
. 0 O11 027 291" 198° 196° 
a obtained results and draw con- ; 990 737 001 012 013 
N 162 162 162 162 162 


*p< 06." p< M1 


Table 6 shows there are no statistically significant connections between factor 1 Importance of 
scientific and technical contents and the elements of implementing cognitive constructivist way of teaching 
scientific and technical contents. Neither are there statistically significant connections between factor 2 
Need for scientific and technical education and the elements of implementing cognitive constructivist way 
of teaching scientific and technical contents. 

Factor 3 competence for quality scientific and technical education is statistically significantly 
connected to all six elements. Teachers who rate higher their competences to teach Science and Technics, 
Statistically significantly more often organize classes where pupils perceive phenomena and ask questions 
(p = .001): collect information with research problem tasks (p = .000); formulate assumptions (hypotheses) 
on possible answers to questions or solutions to problems (p = .001); examine assumptions (p = .007); 
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carry out experiments/tests (p = .016); analyze obtained results and draw conclusions (p = .001). Factor 4 
Professional enthusiasm is statistically significantly connected to four elements. Teachers who express a 
higher degree of enthusiasm, statistically significantly more often organize classes where pupils perceive 
phenomena and ask questions (p = .010); examine assumptions (p = .013); carry out experiments/tests 
(p = .000); analyze obtained results and draw conclusions (p = .012). Factor 5 Difficulty of teaching 
science and Technics is statistically significantly connected to two elements. Teachers who rate higher the 
difficulty of teaching Science and Technics, statistically significantly more often organize classes where 
pupils examine assumptions (p = .001); analyze obtained results and draw conclusions (p = .013). 


Discussions 


To achieve high-quality knowledge of pupils it is crucial to respect the didactic principle of learning 
activity. Cognitive constructivist teaching model is based on the assumption that pupils actively build the 
system of their own knowledge, with teachers having the role of providing adapted cognitive in emotional 
support. In our research, pupils’ activities are covered in 6 elements of cognitive constructive model. We 
found out that out of the six elements of cognitive constructivist teaching model, teachers often organized 
activities where pupils perceive phenomena and ask questions (56.2%), collect information with research 
problem tasks (53.%) and carry out tests (47.9%). Activities where pupils formulate assumptions 
(hypotheses) on possible answers to questions or solutions to problems (47.9%); where pupils examine 
assumptions (58.6%) and where they analyze obtained results and draw conclusions (51.5) were carried 
out occasionally. It has to be pointed out that grade 2-I do rarely has a somewhat higher share in three 
items: pupils formulate assumptions (hypotheses) on possible answers to questions or solutions to 
problem (36.1%); pupils examine assumptions (20.7%), and pupils analyze obtained results and draw 
conclusions (24.3%). 

The research showed that the elements of cognitive constructivist way of teaching scientific and 
technical contents were more often organized by teachers who rated higher their competence. The 
importance of competent teachers for quality implementation of their professional role is confirmed 
in numerous studies (Brophy and Good, 1986; Marzano, Pickering and Pollock, 2006; Hattie, 2009, 
2018; Darling-Hammond and Richardson, 2009). Deriving from the obtained results, it is important that 
already during their studies students have opportunities to obtain insights into characteristics of cognitive 
constructivist way of teaching and develop skills of forming a cognitive conflict and of scaffolding as 
basic characteristics of cognitive constructivist model. The very elements of formulating hypotheses and 
their examination are the items for which a greater share of teachers claim their rare implementation. It 
is necessary to emphasize that cognitive conflict and providing scaffolding for pupils who have various 
Capabilities, previous knowledge and motivation requires from teachers to observe the didactic principle 
of learning differentiation and individualization. 

If students are to be trained in cognitive constructivist way of teaching scientific and technical 
contents, it is important that they themselves receive this way of teaching during their studies (Richardson, 
1997; Valencic Zuljan, 2007). In this context, didactic strategies of “open teaching” are important - such 
as problem-based approach, project work, research teaching. Numerous studies point out the importance 
of problem-based approach (Roth, 1995, as cited in McRobbie, Ginns and Stein, 2000; McCormick et 
al., 1996, as cited in McRobbie, Ginns and Stein, 2000) for heightening the awareness of technology 
and technology education. (Andersno & Walvoord, 1990, 1993, as cited in McRobbie, Ginns and Stein, 
2000; Shapiro, 1996; Swain, 1991; Tyler, 1992). “The problem-solving access to educational content is 
always in the function of enabling students to experience, understand and evaluate the content that is 
being studied.” (Mezak and Pejic Papak, 2019). Organization and teaching procedures should be chosen 
to maximize and sustain the student's thought activity and contribute to their conclusions and decision 
abilities. 

McRobbie, Ginns and Stein (2000) carried out an investigation, using an interpretive research 
methodology, of preservice primary teachers’ prior perceptions of design and technology and changes 
in their perceptions of design and technology as a result of their engagement in independent technology 
projects. In the research, there were 130 participants, enrolled in a one-year postgraduate teacher 
education program. Research findings confirmed the importance of including independent technology 
projects in courses for preservice primary teachers as a way of changing their perceptions of technology 
and technology education. Numerous studies (Anderson & Walvoord, 1990, 1993, as cited in McRobbie, 
Ginns and Stein, 2000; Shapiro, 1996; Swain, 1991; Tyler, 1992) confirm that engagement in independent 
investigations can stimulate changes in students’ thinking and a broader understanding of technology. 
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What is crucial is the experiential learning of students future teachers through current open downto- 
earth problems, as this contributes to a deeper personal understanding of learning contents and increased 
professional enthusiasm. 

The research showed that teachers with a higher level of enthusiasm statistically significantly more 
often carried out elements of cognitive constructivist teaching model and more often organized classes 
where pupils perceive phenomena and ask questions; examine assumptions; carry out tests, and analyze 
obtained results and draw conclusions. The importance of teacher’s enthusiasm has been confirmed in 
numerous studies (Rosenshine, 1970; Rosenshine and Furst, 1973; Brophy and Good, 1986; Patrick et 
al., 2003; Turner et al., 1998). Brophy and Good (1986) define “teacher enthusiasm” as one of the teacher 
qualities that significantly influences effective teaching. Rosenshine (1970), and Rosenshine and Furst 
(1973) established that teacher's enthusiasm and passion for the subject they teach correlate with pupils’ 
achievements. Therefore it is important for students and teachers to be familiar with studies on the impact 
of teacher's enthusiasm, and also to research their own teaching in the perspective of the influence of 
enthusiasm on pupils. Loncaric and Pejic Papak (2009) emphasize the importance of teacher's research, 
which positively influences their professional commitment. Teachers’ research is also an important factor 
of their professional development (Marentic Pozarnik, 2018; Vogrinc and Valencic Zuljan, 2009; Valencic 
Zuljan, 2018). 

The research showed no statistically significant differences between the frequency of implementing 
elements of cognitive constructivist way of teaching scientific and technical contents and factors 
Importance of scientific and technical contents and Need for scientific and technical education. We found 
out that teachers who rate higher the difficulty of teaching scientific and technical contents statistically 
significantly more often implement two of the six elements of cognitive constructivist model of teaching, 
namely they more often organize classes where pupils examine assumptions; analyze obtained results 
and draw conclusions. 

Our research showed that the elements of cognitive constructivist way of teaching are more often 
organized by teachers with greater concern of their professional development, in our research measured 
with observance of new scientific research findings referring to learning, teaching and other subject matter 
as well as the reflection on their own pedagogic practice. In view of our study findings and the fact that 
professional development presents one of the basic competences of the modern teacher, it is important 
that already during their studies students future teachers are familiarized with the research on teacher's 
professional development and raised to awareness that taking care of their professional development is 
a basic value. 


Conclusions 


The results of our study lead to the conclusion that all 6 elements of cognitive constructivist way of 
teaching should be strengthened, since grade 5 - (very often) does not have a high share in any element, 
which however would be expected given the importance of cognitive constructivist way of teaching 
scientific and technical contents. For quality teaching of natural and technical contents, the share of the 
following three items should particularly be strengthened: Pupils formulate assumptions (hypotheses) on 
possible answers to questions or solutions to problem; Pupils examine assumptions, and Pupils analyze 
obtained results and draw conclusions. 

Data from our research lead to the conclusion that the frequency of implementing elements of 
cognitive constructivist teaching model is linked to the teachers’ concern for their own professional 
development, since those who use new scientific research findings in their work and regularly reflect on 
their own pedagogical practice, statistically significantly more often organize elements (4 to 6) of cognitive 
constructivist way of teaching. 

The research showed that the frequency of implementing elements of cognitive constructivist way 
of teaching Is statistically significantly connected to 3 out of 5 factors: Competence for quality scientific 
and technical education (in all 6 elements); Professional enthusiasm (in 4 elements), and Difficulty of 
teaching Science and Technics (in 2 elements). 

It would be sensible to continue research, which would additionally help shed light on the reasons 
for the findings of our study, among others class teachers’ attitudes to the importance of cognitive 
constructivist way of teaching, what obstructs them in introducing this way of work, in which elements 
they would need additional support at the level of school or support in additional education at the system 
level, etc. 
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Abstract: The research is basically aimed at studying the students’ conceptual structure and basic beliefs being formed 
and correlated as well as at their classifying in accordance with the level of integration and coherence. The students’ conceptual 
structures and basic beliefs are analyzed in the article; special attention is paid to semantic, categoric and conceptual abilities 
coherence (homogeneity) and formedness. If speaking about methodology of the research, it includes theoretical and empirical 
methods. Theoretical, cluster and factor analyses as well as the Kruskal-Wallis rank sum test allowed us to define 5 clusters 
(groups) with low, medium-low, mean (average), high and extraordinary indices of the students’ conceptual structure and basic 
beliefs formedness. These clusters significantly differ at levels from ps0.01 to ps0.05. The students’ conceptual structure and 
basic beliefs correlations form the level systems classification characterized by different coherence of these levels. It is sufficient 
to conclude that different basic beliefs are the core of the students’ subjective inner world and are correlated with these beliefs 
conceptual structures specificity. The attained results prove the phenomenon of the intellectual resource “splitting”: the intellectual 
resource can split into productive and non-productive components in case of high-level intelligence, i.e. if the intelligence level 
is too high the intellectual resource and its basic components can be insufficiently formed and/or poorly developed. 

Keywords: Conceptual structures, basic beliefs, correlations classification. 


Introduction 


since the notion “basic beliefs” was defined by S. Epstein in his cognitive-experimental theory 
and by R. Janoff-Bulman’s personal basic beliefs cognitive concept, lots of researchers use it as the 
basic variable to explain the features of a person’s surrounding world events perception and to define 
persons behavior peculiarities. The way the persons interpret the events that take place in their lives (i.e. 
mentioning the ability to gain new experience, paying attention to any possibility for personal development 
or just perceiving them as unfair or an obstacle) has a great influence on their well-being, success and 
being satisfied with their life or not. This aspect is particularly relevant for young people who are in their 
early stages of adulthood. At the same time those young people who perceive the world as absolutely 
unfair and the relations with others — hostile or adversarial, have a low self-esteem and value their 
opportunities at a low level are of a great need in psychological support because in conditions of personal 
formation these people can be on the outside of an active and successful interaction with the world, 
with themselves and others. On the other hand, people with the well-developed sense of purpose and 
positive basic beliefs are of great importance for society; they help the society to be in progress. That 
is why psychological and pedagogical support of the young people having negative basic beliefs is one 
of the most important and modern trends in psychological work. But this help implementation requires 
understanding the mechanisms and predictors of basic beliefs forming. These predictors can include 
cognitive resource (aimed at processing information, i.e. defining the character of a human's personal 
perception of the surrounding world). Thus, the research is aimed at studying the connection of conceptual 
structures (as the basic part of the cognitive resource) and basic beliefs of the young people (students). 


“Corresponding author: kibalirina@sfedu.ru 
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It has already been mentioned that basic beliefs are the person's hierarchically organized 
cognitive and emotional implicit opinions, judgments and knowledge, which help the person to 
perceive the events of the surrounding world (Kibal’chenko and Eksakusto, 2020; Padun and 
Kotel’nikova, 2008). Most of the researches carried out and connected with the basic beliefs 
and their impact on perceiving the events of person's life let us make the following conclusions. 

First of all, persons’ basic beliefs are connected with the PTSD symptoms severity condition, with 
the quantity and types of traumatic events as well as with the ability of post traumatic growth. The maximum 
effect while working with victims is observed on the level of basic beliefs about the surrounding world 
functioning (Bulman and Timko, 2020). Those people who had any traumatic event (e.g. physical/somatic 
disease, active service/commitment, lost their relatives, loss of their motherhood and/or home (refugees)) 
in their lives are characterized by such basic beliefs as “Benevolence of the World”, “Benevolence of 
People” and “Luck” being negatively expressed (Ter Heide, Sleijoen and van der Aa, 2017; Dekel at all., 
2004; Ward and Plagnol, 2019). It is found out that a long period of the existential stress impact bringing 
person to depression is accompanied by negative attitude to benevolence of the world, being sure that 
the world is unjust and uncontrolled as well as by the low self-esteem and poor belief in commitment to 
succeed (Zatuski, 2015; Padun and Kotel’nikova, 2012). The basic beliefs are proved to be the so called 
“mediator” between traumatic event and dissociation and the strongest connection of these problems 
is found with the beliefs of the world benevolence and self-esteem (Lilly, 2011). The research made by 
Goldenberg, |., Matheson, K. shows that posttraumatic stress symptoms are poorly expressed in a group 
of those people who had any traumatic event in their lives but still have positive basic beliefs of the world; 
these people are likely to use active and constructive strategies in challenges overcome and problems 
solving (Goldenberg and Matheson, 2005). Some people having traumatic events (splitting personal 
basic beliefs of themselves, world and others) are as well characterized by the effect or posttraumatic 
growth: they are able to reconsider their basic beliefs after the traumatic event, i.e. the integrative system 
of beliefs can be reconstructed (Mazor, Gelkopf and Roe, 2020; Lahav, Bellin and Solomon, 2016). 

secondly, basic beliefs are the basis of the human's subjective well-being, allowing human to be 
Stable (robust), satisfied and successful in different spheres of life and happy while interacting with others. 
some researches reflect the idea of people having stable positive basic beliefs of the benevolence of the 
world, being characterized by the higher level of well-being in general and in separate spheres of their 
lives (health, social relations, educational activity, etc.) (Dzuka and Dalbert, 2006; Belyaeva, Kyoppel’ 
and 2018; Shelegina, 2018; Tsvetkov, 2020; Lifshits, 2019; Elshanskij, 2020). On the other hand, external 
negative influence (bullying, mobbing) can destroy positive basic beliefs of self-esteem, other people 
(and relations with them) estimation, benevolence of the world and bring person to subjective ill-being 
and stress reactions (Mikkelsen, 2001). It is also found out that basic beliefs of the benevolence of the 
world and its controllability can sufficiently define the processes of adaptation and challenges overcome. 
Taking physically challenged people as an example, it was proved that the basic beliefs destruction 
can lead to longer period of rehabilitation and adaptation (Monden et al., 2016). Herewith, being stable 
(robust) and having positive basic beliefs, in case of any traumatic event, people continue having positive 
emotions towards the world around and have just insufficient functional disturbance (Bonanno, 2004). 

Modern researches show that the basic beliefs (hope, belief in a just and controlled world and 
events, etc.) determine the aim of life and being satisfied with it; and if the levels of these factors grow up 
the level of stress and anxiety caused by Covid-19 grows down. Trzebinski, J., Cabanski, M., Czarnecka, 
J. Z. suppose that basic beliefs can be called “buffer” redeeming from anxiety, unproductive thinking 
and making decisions in case of an unpredictable threat (Trzebinski, Cabanski and Czarnecka, 2020). 

Taking into account the importance of basic beliefs for a person’s world and various events perception, 
separate and few studies are also aimed at finding the predictor of developing such faiths as belief in a just 
world, ina value of human selfhood, in controllability ofthe world. These studies suggest that these predictors 
include conceptual thinking and conceptual structures forming the basis of a person’s intellectual resource. 

Nowadays the problem of conceptual thinking and conceptual structures of personality is the 
most popular topic in psychological and interdisciplinary research for scientists and researchers around 
the world. Theoretical analysis of this problem studying basic approaches helps to make a suggestion 
that the most promising one Is to study conceptual thinking and its structural features as a form 
of an individual intelligence integral work as a whole; the information processing elaboration as well 
as regulation and motivation are considered being core components of intellectual activity (Pulyaeva 
and Nevryuev, 2020; Gavrilova and Leshcheva, 2013; Volkova and Gusev, 2016; Maksimovic and 
Osmanovic, 2019). The conceptual abilities forming conceptual structures play a leading role among 
different types of cognitive abilities and are represented in three forms: semantic abilities (digestion, 
storage and updating of the verbal signs content); categoric (categorical signs, characterized by different 
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generality degrees, separating and operating) and conceptual abilities (new mental contents generating). 
This research studies conceptual abilities as the mostimportant ones among all conceptual structures. 
Theoretical analysis showed that person's conceptual abilities are manifested in categorization, explanation, 
interpretation, ina predominant cognitive style and reflect the features of a person’s cognitive assessment of 
the world around him/her (events, situations, etc.) (Quillien, 2020). Understanding and analyzing the events 
and transformations taking place is determined by the level of conceptual abilities developmentandleadstoan 
understanding of correlations being the bases ofthese transformations/changes (McCaslin and Kilrea, 2019). 
For example, the study held by L. Shi and co-authors showed that the higher the mental 
Capacity, adaptability and flexibility of a human and his/her informational connections are, the 
higher his/her well-being is (Shi, et al., 2018). It was also found that cognitive assessments of an 
upcoming event (their favorability in terms of self-efficacy, control and, optimism) have an impact 
on coping with the situation (distress, being satisfied with decision-making) (Major et al., 1998). 
It should be emphasized that conceptual abilities are the key ones among intellectual abilities; 
they are the mental qualities making conditions for new (absent in actual circumstances or in absorbed 
basic knowledge) mental contents generating. The following criteria are identified as conceptual 
abilities: identification of implicit signs and connections; creating new beliefs and ideas; constructing 
a variable number of the situation versions, etc. (Holodnaya and Hazova, 2017). Conceptualization 
brings about managing own personal resources and “creating” new ones (Hazova, 2016). 
The fact of the conceptual structures (and, in particular, conceptual abilities) being connected and 
correlated with basic beliefs (being a part of the personality worldview) is confirmed by separate studies 
conducted in the context of the psychology of intelligence and the intellectual resource of personality 
(Holodnaya, 2019; Hazova, 2018; Trifonova, 2016; Artemova and Lezhnina, 2016). The authors found out 
thatthe degree of conceptual abilities developmentand basic beliefs character determine the overall success 
of person (Kibal’chenko, Eksakusto and Istratova, 2017). We have also identified “harmonious” models of the 
basic beliefs productive aspects intellectual predictors. For example, the self-control (SC) predictors system 
includes: directly related styles “Reflexivity”, “Abstract conceptualization’, “Field independence” and the 
inversely related style “Rigidity”. All styles ofthis system, taking into accountthe inverse relation with “Rigidity”, 
create a harmonious unit for the degree of self-control assessing (Kibal’chenko and Eksakusto, 2020). 
TheresearchcarriedoutbyS. Jeavons,K.M.Greenwoodpointsouttheconnectionofbasicassumptions 
and cognitive appraisal; at the same time factor structures of strategy, attributions and cognitive assessment 
were incomplete and unstable that demands additional check of results (Jeavons and Greenwood, 2007). 
Correlation of the intellectual and personal resources represented by basic beliefs shows that the higher 
intelligence indices are, the lower the faith in controllable world is, as well as the average intelligence level 
determines belief of benevolence of the world and a high self-worth index (Budakova and Matsuta, 2016). 
The relations between conceptual abilities and basic beliefs form a dyad of the foundations of a 
person's value-sense and conceptual view of oneself, other people and the world as a whole; this dyad 
depends on coherence (homogeneity) of conceptual abilities and basic beliefs indices being well/poorly 
formed (Kibal’chenko, Istratova and Eksakusto, 2019). The study of this connection is of great importance in 
terms of its manifestation peculiarity among young people (students) being a special group characterized by 
different level of intellectual and personal resources integration; this difference depends on age (integrating 
ideal and real during mental activity) and social (low vital capacity, contradictory basic beliefs) features. 
In our opinion, the results of the analysis and the assumptions put forward provide an empirical 
study of the conceptual structures and basic beliefs correlations. It is therefore important to define 
connection between conceptual structures and basic beliefs empirically. Hypothetically, the relations 
between conceptual structures and basic beliefs form systems with different coherence (homogeneity) 
and have their own features. These differences depend on the fact that different basic beliefs, being 
the core of the human subjective world, are connected with the special nature of individual conceptual 
structures. 


Materials and Methods 


The following methods and techniques were used to define the conceptual abilities and basic 
beliefs indices: 

1. Conceptual categoric abilities assessment: “Three words meaning generalization” (Holodnaya 
et al., 2019). 

2. Semantic and conceptual abilities assessment: “Problem statement’, “Pictorial and verbal 


interpretation’, “Concept cognitive content” (Holodnaya, 2019). “Resource” is used as a key cue word. 
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3. The following methods were used for each ability unit: “Words free sorting test’ (Kolga): 
“Conceptual synthesis” (Holodnaya et al., 2019; Holodnaya, 2019). 

4. World assumptions scale (WAS) (R. Janoff-Bulman) was used to study such indices as 
“Benevolence of the World”, “Meaningfulness of the World” and “Self-Worth’. 

5. The methods of the results processing and interpreting are as follows: hierarchical cluster 
analysis with more than two variables was used to define coherent (homogeneous) groups; statistic 
criteria (Kruskal-Wallis one-way analysis of variance) and Cluster method were used to define within- 
groups linkage and factor analysis in SPSS (IBM SPSS Statistics Subscription Trial for Mac OS). 

One hundred and thirty-four Southern Federal University students (76 males and 58 females) took 
part in the research. Average age of the respondents was 20.5 years (19-22 years old). 55.7 per cent male 
and 44.3 per cent female students. 


Results 


According to the purpose of the research and the hypotheses formulated, the diagnostic results 
were used for hierarchic cluster analysis at the first stage of the study; the analyses included the following 
students’ data: indices of the conceptual thinking and basic beliefs formedness level; conceptual synthesis; 
the concept generality degree; ability to identify variety of concepts content private and common features; 
ability to match concepts to categoric and class-descriptive commonalities; the students’ basic beliefs 
level indices. 

Independent clusters - homogeneous (coherent, congeneric) groups, shown in fig.1, were defined 
during the process of clustering. 
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Figure 1. Tree diagram of the analysis results clustering 


Each cluster is a group including results of students with maximally related conceptual structures and 
basic beliefs formedness levels. The first cluster includes 29.3 per cent of students; the mean observation 
is 2.32 points in conceptual structures formedness and 2.21 points in basic beliefs formedness level. 

The second cluster includes 16.7 per cent of students with the following mean values: 3.2 points in 
conceptual structures and 2.9 — in basic beliefs formedness level. 

The third one is represented by 31.4 per cent of students, characterized by 3.4 points in conceptual 
structures formedness level and 3.31 — in basic beliefs formedness level. 

The fourth cluster includes 16.4 per cent of students with 4.4 and 4.39 points in conceptual structures 
and basic beliefs formedness level. 

The fifth cluster is thin on the ground (6.3 per cent of students), but significantly differs from all 
previous ones in conceptual structures and basic beliefs formedness level. The mean value here is 6.00 
and 9.02 points respectively. 

Thus, five results “casts” were defined taking into account clusters quantitative content; this fact 
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helped us to identify five homogeneous groups of students and to study peculiarities of the conceptual 
structures and basic beliefs correlation. 

All the students were split up into five sampling groups in accordance with the defined clusters; 
these sampling groups differ in a level of students’ conceptual structures and basic beliefs formedness: 

* group characterized by low level of conceptual structures and basic beliefs formedness (cluster 
No. 1); 

¢ group with medium-low indices (cluster No. 2); 

¢ group with medium (average) indices (cluster No. 3); 

¢ group characterized by high indices (cluster No.4); 

¢ and a group with extraordinary indices of conceptual structures and basic beliefs formedness 
level (cluster No. 5). 

The students are symmetrically grouped into clusters in accordance with the formedness levels, but 
their quantity in these groups is asymmetrical. 

The statistic processing of the results was held on the second step of the research; the Kruskal- 
Wallis one-way analysis of variance was used to analyze five groups (clusters) according to the following 
indices: categoric generalization; conceptual synthesis; involuntary categorization; cognitive content 
of the “resource” concept; pictorial and verbal interpretation of the “resource” concept; the “resource” 
concept problem statement and the students’ basic beliefs formedness level indices. 

The groups do not differ in three variables of the eleven ones, i.e. equality of these groups is 27.2 
per cent, but in 72.8 per cent these groups (clusters) of students significantly differ. Three variables 
connecting the clusters are as follows: 

associative categorization, i.e., awareness of the categories meanings, ability to use variety of 
concepts (categoric generalization - CG). This fact proves that all the students participating in the 
research are characterized by a very similar level of the categories meaning awareness; 

« the degree of semantic context complexity (conceptual synthesis — CS), i.e. general idea of the 
described “resource” concept; 

¢ the level of the conceptual experience formedness in a structure of the students conceptual 
thinking (problem statement — PS), i.e., the abilities to tease out the variety of private and general 
features and to match concepts to categoric and class-descriptive commonalities do not differ 
significantly. 

Statistically significant differences are teased out in accordance to the following characteristics: 

¢ involuntary categorization — IC (the levels of involuntary intellectual control) (hemp. = 13.76, 
o<0,01). The better the conceptual structures and basic beliefs are formed, the higher the level of 
involuntary categorization is; 

« — the levels of the “resource” concept cognitive content (CC) formedness (hemp. = 23.92, ps0.01) as 
a stimulus reflecting the students’ personal success. This data show that the students of different 
groups defined during the research are characterized by different levels of awareness of personal 
success concepts; by different understanding and using the gained experience for each concept. 
The better the conceptual structures and basic beliefs are formed the higher the level of the 
students’ awareness of personal success concepts and their ability to use their experience are: 

¢ — integral conceptual structures including the pictorial and verbal interpreting (PVI) of the “resource” 
concept (hemp. = 7.41, ps0.05.), i.e., the students’ ability to express personal experience through 
mental images of this concept is formed differently. The better the conceptual structures and basic 
beliefs are formed the higher the level of ability to express personal experience through mental 
images of the concept is; 

* general index of the conceptual thinking (CT) (hemp. = 57.08, ps0,01). 

Five groups were analyzed diagnostically and in accordance with basic beliefs major characteristics; 
the results of this analysis defined significant differences in the following indices: 

* general attitude to the “benevolence of the world’, “just of the world” and “benevolence of people” 
(BW) (hemp. = 21.89, ps0,01); 

¢ general attitude to world understanding, events controllability, being just and occasional (WU) 
(hemp. = 22.55, pS0,01); 

¢ — beliefs of self-worth, self-control and ability to control and to rule the events (SW) (hemp. = 22.77, 
ps0,01): 

¢ — basic beliefs formedness mean value (BB) (hemp. . = 53.53, ps0,01). 

These differences show that the students included in the groups defined by cluster analysis are 
characterized by dissimilarities in “subjective core of personality’, general view of the world, development 
characteristics harmony and balance and basic beliefs formedness. 
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The results of the statistic analysis prove our suppositions: 
¢ — the students’ semantic, categoric and conceptual abilities coherence with their basic beliefs differs 
in levels; 
« the students whose basic beliefs are well-formed (vs. the students whose basic beliefs are not 
formed or poorly-formed) are characterized by high level of conceptual structures formedness. 

The differences defined at the second stage of the research helped us to carry the third step and 
to study the peculiarities of the conceptual structures and basic beliefs correlation in each group (cluster). 

The “resource” stimulus was studied at the stage of factor analysis as a general ability of a person 
preconditioning success. This fact helped to lower the number of variables and to define coherence 
(homogeneity) of the students’ conceptual abilities and basic beliefs formedness indices. 

Factorization of the first group of students (with low level of conceptual structures and basic beliefs 
formedness) defined as a cluster No. 1 is as follows: the summary dispersion as a result of factor analysis 
is 68.7 per cent. A full three-component factor structure resulted from rotation (varimax with Kaiser 
Normalization); this structure is characterized by direct correlation prevailing, but also includes two indices 
with inverse correlation (Table 1). 


Table 1 
Factor structure of the students’ semantic, categoric and conceptual abilities indices coherence 
with their basic beliefs ones (group 1 - with low results) 


Components in group 1 


Characteristics 
F4 F2 F3 
CG 0,79 -0,29 -0),04 
ES 0.44 0,51 -0),40 
je 0,58 0.23 -0,63 
EC 0.25 -0,65 0.08 
PS 0.00 0,39 0,70 
PVI 0.25 0,68 0.23 
BW 0,82 -0,15 0.26 
WU 0,92 0,07 0.14 
SF 0,83 -0,10 0.19 
Percentage load 34f 90,2 66,/ 


F1 is maximally loaded, crystallizing. It includes directly correlated indices of such variables as 
categoric generalization and basic beliefs general direction indices (i.e. belief in benevolence of the world, 
benevolence of people, the good prevailing over the evil, events controllability and just, belief in ability to 
control the events). 

F2 includes direct variables (conceptual synthesis, “resource” mental representation) and inverse 
index of this concept awareness. This distribution proves disharmonic, discordant correlation between 
conceptual structures and mental abilities of these students; i.e. the “resource” concept pattern is formed, 
but these students’ awareness of this concept field content is poorly-developed because they have lack 
of necessary experience in using the “resource” concept content. 

F3 includes the directly and inversely correlated indices of the “resource” concept experience and 
the form of involuntary intellectual control. Thus, the students of this group are characterized by indices 
narrow equivalence range (analyticity) if they have a potential in problem statement. This fact indicates 
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lower rates of involuntary and associative memorizing; as well as the ability to operate better with accurate 
rather than abstract conceptual structures. 

The students of the second cluster (group 2) characterized by medium-low conceptual structures 
and basic beliefs formedness indices showed the following results: the summary dispersion as a result of 
factor analysis is 76.5 per cent; this is a fact of integrity of the results. 

The four-component full factor structure (Table 2) resulted from the analysis; the character of 
correlations is mixed (direct and inverse ones). The first three factors are of great interest and the fourth 
one is unstable. 


Table 2 
Factor structure of the students’ semantic, categoric and conceptual abilities indices coherence 
with their basic beliefs ones (group 2 - with medium-low results) 


Components 
Characteristics 

F4 F2 F3 FA 
CG -0,02 0,62 -0,01 0.48 
CS -0,14 0,87 0.16 -0),04 
IC 0,39 0,80 -0.10 0,05 
CC 0.37 -0.16 -0,76 0,03 
PS -0,86 -0.08 0,12 0.26 
PVI -0),28 0.15 0.11 0,79 
BW 0.24 -0.07 0,87 0.06 
WU 0,54 0.18 030 0,53 
SF 0,91 0,08 0.13 -0,04 


Percentage load 20,0 A654 63,1 16,9 


F1 includes characteristics of conceptual abilities (“resource” problem statement) inversely 
correlated with basic beliefs (meaningfulness of the world and self-worth) characteristics. This factor 
reflects the gaps of the students’ individual intellectual and personal resource integration. 

F2 includes semantic, categoric and conceptual abilities (such as categoric generalization, 
conceptual synthesis and involuntary categorization) formedness indices. Thus, the conceptual structures 
are differentiated in a structure of intellectual and personal resource; this fact correlates with the ‘st factor 
gaps. 

F3 shows an inversely directed correlation between the belief of the benevolence of the world and the 
“resource” concept cognitive content. The contradictory correlation between the belief in the benevolence 
of the world and awareness of personal current and potential opportunities leads to the conclusion that 
there are some gaps in adaptive potential of the students included into this group. Moreover, they are 
unable to manage their intellectual and personal resource and the events constantly. 

F4 contains only one variable and is unstable. 

If speaking about the students included into the 3rd group (with mean (average) indices of the 
conceptual structures and basic beliefs formedness) and factorization of the analysis results, we can say 
that the summary dispersion here Is 71.0 per cent. The three-component full factor structure, characterized 
by direct connection, resulted from rotation (Table 3). 
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Table 3 
Factor structure of the students’ semantic, categoric and conceptual abilities indices coherence 
with their basic beliefs ones (group 3 - with mean (average) results) 


Components 
Charactenstics 

F 4 F? F3 
CG 0,86 0.00 0.24 
(S 0.06 -0.10 0,80 
IC 0,70 -0,29 0.12 
CC 0.16 0.10 0,82 
PS -0.15 0,84 0.07 
PVI 0.16 0,78 -0.04 
BW 0,74 0.26 0.44 
WU 0,73 0.14 0.39 
SF 0,68 0.07 0.54 


Percentage load 316% 46.7% 1% 


F1 is crystallizing in this group and includes five characteristics: three basic beliefs indices and 
categoric abilities of associative and involuntary categorization. This factor is characterized by basic 
beliefs and conceptual structures integration. 

F2 includes indices of the “resource” notion conceptual experience and mental representation, i.e., 
the students of this group create (plan) their resource from the point of view of understanding. 

F3 includes the indices of the “resource” notion conceptual synthesis and cognitive content and 
amplify the indices of the second factor. 

It should be mentioned that the factor structure of the students’ semantic, categoric and conceptual 
abilities coherence with their basic beliefs is harmonic; |.e., the conceptual structures and basic beliefs of 
the students included into this group systematically form and develop and create an integrated individual 
personal resource. Students’ success and their abilities and qualities further development directly depend 
on the level of personal resource formedness. 

The students of the fourth cluster (group 4) characterized by high conceptual structures and basic 
beliefs formedness indices showed that the summary dispersion here is 81.3 per cent. 

The three-component full factor structure resulted from rotation (Table 4). 
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Table 4 
Factor structure of the students’ semantic, categoric and conceptual abilities indices coherence 
with their basic beliefs ones (group 4 - with high results) 


Characteristics Components 

F 1 F? Pa 
CG -0,86 0.12 -0,03 
CS 0.06 0,94 0.08 
IC 0,29 071 0,88 
CC 0,82 -0,10 0.45 
PS -0,54 0,70 -0,18 
PVI 0.19 -0,02 0,93 
BW 0.08 0,66 024 
WU -0,04 0.5/7 0,66 
=F 0,90 026 0.14 


Percentage load 243 54 / 13 


F1 combines such directly correlated indices as self-worth, ability to control the events and luck, 
“resource” concept cognitive content and inversely correlated index of categoric generalization. That 
means that the students point out different sufficient signs of the “resource” concept in different situations. 

Two other factors have the signs of intellectual and personal resource integration. 

F2 is represented by direct correlation of conceptual synthesis, conceptual experience concerning 
the “resource” stimulus, general attitude to the benevolence of the world, belief in good prevailing over evil 
and good people number prevailing over bad one. 

F3 includes directly correlated indices of involuntary categorization, the “resource” concept mental 
representation and attitude to meaningfulness of the world. 

The fifth group (it 6.3 per cent of all students and is characterized by an extraordinary indices of 
the conceptual structures and basic beliefs formedness level) results factorization showed the summary 
dispersion of 100 per cent. The three-component factor structure resulted from rotation (Table 5). 
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Table 5 
Factor structure of the students’ semantic, categoric and conceptual abilities indices coherence 
with their basic beliefs ones (group 5 - with extraordinary results) 


Characteristics Components 
F 4 F2 F3 
CG -0.67 0,65 0,36 
CS -0,06 0.98 -0.16 
IC 0.96 0,28 -0.08 
CC -0,15 -0,97 0.18 
PS -0,13 0,44 -0,89 
PVI 0,98 -0,06 -0.17 
BW 0.63 0,69 0,36 
WU 0,97 -0,05 0,23 
SF -0,13 0.10 0,99 
Percentage load Ai 4 15,8 100 


F1 consists of such directly correlated indices as general attitude to the meaningfulness of the world, 
“resource’ concept mental representation, involuntary categorization and inversely correlated categoric 
generalization. These students handle class-descriptive categories found and defined on their own; they 
call these categories in their own way through the lens of sufficient index and sign. At the same time, their 
attitude to the world is meaningful and they structure the image of their intellectual and personal resource. 

F2 includes directly correlated indices of the general attitude to the benevolence of the world, 
conceptual synthesis and inversely correlated index of the “resource” concept cognitive content. This 
factor as well as the first one expresses peculiarities of the personal resource and formedness of the 
conceptual synthesis studied as the sign of highly-developed conceptual abilities. These abilities are a 
“peak” of the conceptual structures development. 

F3 is formed by directly and inversely correlated indices of conceptual experience concerning the 
“resource” stimulus and self-worth as well as the ability to manage and control the events and luck. It can 
be supposed that the students of this group are not satisfied with themselves and their achievements and 
gains. 

The results of the factor analysis let us state that each group of students is characterized by specific 
peculiarities of the conceptual structures and basic beliefs correlations. 


Discussions 


The results received during the research demonstrate that the students included into the groups 
revealed in a course of a groups clustering, have various levels of involuntary intellectual control; this 
fact is a testimony to different levels of intellectual, emotional, motivational, spiritual and axiological 
resources integration. Different levels of personal success awareness, realizing different levels of gained 
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experience connection with the “resource” as well as different levels of conceptual experience indicate 
different degrees of these structures being integrated into the general intellectual and personal resource 
of students. Significant differences in levels the of basic beliefs formedness prove that students have 
absolutely different understanding of the world and of themselves. Their beliefs in positive moments 
predomination over bad ones, in a fact that events can be controlled and their ability to manage and 
control these events also differ a lot. 

Thus, the fact of semantic, categoric, conceptual abilities of the students being formed and coherent 
with their basic beliefs is statistically confirmed, has a level-based character and can be classified. The 
basis for classification is the degree of the students’ conceptual abilities and basic beliefs development 
indices coherence (homogeneity). 

Five factor structures are defined in a course of studying the qualitative characteristics of the 
students’ conceptual abilities and basic beliefs development indices coherence; these characteristics 
describe directions of the basic beliefs and conceptual thinking structures relations in each group. 

The first group includes the students with poorly developed conceptual structures and basic beliefs. 
They are characterized by low semantic, categoric and conceptual abilities formation values as well as 
by low level of “Benevolence of the World”, “Meaningfulness of the World” and “Self-Worth” concepts 
formation. The description of this group students’ basic beliefs and conceptual structures connection 
shows that the general level of the basic beliefs coherence with the mental representation of the concepts 
regarding their success as well as with the arbitrary form of controlling the states of their individual resource 
is in contradiction with the involuntary control of the intellectual resource and the ability to operate on 
the gained experience in general. The characteristics of the students included into this group are of a 
narrow equivalence range (“analyticity”). These results indicate lower rates of involuntary and voluntary 
memorizing; cognitive rigidity, ability to operate and use accurate concept structures rather than abstract 
ones. 

The second group includes the students with medium-low conceptual structures and basic beliefs 
formedness indices. This group Is characterized by contradictions between “Success”, “Self-Worth” and 
“Meaningfulness of the World” conceptual experience formedness. These students are also characterized 
by the lack of awareness of their capabilities to form an image of themselves in the surrounding world. They 
do realize and understand what is going on and what should be, but they are unable to identify themselves 
in these very conditions. Intellectual and personal resources are poorly integrated because conceptual 
structures and basic beliefs are underdeveloped, inharmonic and are contradictorily connected. These 
facts characterize these young people's individual resource as unstable and unformed. 

The third group is represented by students with a mean (average) conceptual structures and 
basic beliefs formedness indices. Despite the fact that students of this group are characterized by mean 
(average) semantic, categoric and conceptual abilities and basic beliefs formedness indices, the character 
of these structures connection in this group is the most harmonious. This fact allows us to conclude that 
the students with mean (average) indices are characterized by steady personal and intellectual resources 
characteristics integration; this kind of integration is the predictor of the students’ socialization success. 
Their conceptual abilities and basic beliefs form an integrated individual resource; the students’ successful 
socialization and their general success depend on the level of this individual resource formedness. 

The fourth group of students having high conceptual abilities and basic beliefs rates and their 
harmonious coherence structure, is characterized by a contradiction between the level of voluntary 
categorization and the ability to operate the concepts variety. This fact proves, that no matter all the 
variables are well formed in this group, these students make inflated demands on their resource and 
Capabilities. In our view, it can be concluded that the students with highly developed conceptual abilities 
and basic beliefs are more demanding of themselves, of society and of the world as a whole. They have 
to alter the conceptual field standard boundaries to harmonize the intellectual and personal resource 
development. 

The fifth group is small-numbered, but is of great interest for additional research. This is a group 
of students with outstanding conceptual structures and basic beliefs formedness indices. These students 
show the necessity of concepts standard boundaries alteration as the students of previous group. Moreover, 
there are some contradictions between correlations of the personal resource from gained experience 
with the “Benevolence of the World” and conceptual experience with “Self-Worth”. Hypothetically, this 
contradiction suggested that such students presented their resources in an unusual and nontypical 
manner. Deeper integration with personal characteristics gives these students an opportunity to reflect 
and correlate their resources and capabilities with standard and required ones. However outstanding 
conditions are necessary in addition to generally accepted standards to develop the potential of students. 
This is due to the effect of indices “splitting” in case of very high conceptual structures results and is 
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accompanied by a number of specific effects, connected, in particular, with structural bonds breakdown. 


Conclusions 


The conclusion that the students’ conceptual abilities and basic beliefs form their intellectual and 
personal resource Is a result of the empirical research. 

The coherence between basic beliefs and conceptual structures (semantic, categoric and 
conceptual abilities) formedness is conditioned by their being connected. 

Thus, the students whose ideas in “Benevolence of the World”, “Controllability”, “Self-Worth’, 
confidence in their ability to manage the events are well-formed and well-developed are characterized by 
the high conceptual structures indices. The conceptual structures of the students with malformed basic 
beliefs are poorly developed. 

The students’ abilities (semantic, categoric, conceptual) formedness coherence with their basic 
beliefs is level-based and represents the classification of their connections, which Is reflected in structural 
features. 

However, the structures are changed when the mean (average) results are exceeded. This scientific 
fact is confirmed by the phenomenon of an intellectual resource “splitting”: the intellectual resource can 
split into productive (intellectual maturity) and non-productive components in case of the high intelligence 
indices. This phenomenon can lead to an intellectual resource limited development and to its basic 
components insufficient formedness. 

Thus, the analysis of the students’ conceptual structures and basic beliefs coherence was conducted 
for the first time; the psychological ambivalence of the students’ conceptual structures and basic beliefs 
coherence was empirically shown and proved taking into account nonlinearity phenomena, indices 
interdependence and intellectual resource “splitting” into productive and non-productive components. 

The group with very high conceptual structures and basic beliefs indices definition allows making 
an integrated idea of some students’ intellectual and personal resource peculiarities and Is a good basis 
for the following research. 
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Abstract: The presented results of the study allow us to determine the ratio of verbal and nonverbal components of 
thinking activity in solving problems of different types. The novelty of the research is in the use of individual cognitive maps made 
on the results of collaborative thinking activity in the study of possible combinations of symbolic (verbal) and figurative (nonverbal) 
components of internal thought processes implemented in different conditions. The study included two methodological blocks. 
The first of them is diagnostic. It consisted of four tasks (a verbal task with one solution, a verbal task with multiple solutions, a 
nonverbal task with one solution, a nonverbal task with multiple solutions), as well as a cognitive map based on the results of 
solving these tasks. The second block is mathematical and statistical, including the Kruskal-Wallis H-test, the Mann-Whitney 
U-test, and the Fried-man chi-square test. The study sample consisted of 80 students of the Don State Technical University. 
As a result of the study, it was found that cognitive maps created with time constraints significantly outperform cognitive 
maps created without such restrictions in terms of figurative, symbolic abstractness and symbolism. Cognitive maps created 
without time constraints significantly outperform cognitive maps created with time constraints in terms of imagery. In general, 
the predominance of the verbal or nonverbal components of thinking can vary significantly, but the general trend towards the 
predominant character of the imagery of thought processes remains. 

Keywords: thinking activity, cognitive map, mental map, components of thinking activity. 


Introduction 


The theory and practice of cognitive mapping Is extremely diverse. The concept of this phenomenon 
changed from an image that captured the external reality to a complex network of verbal and nonverbal 
representations (Solso, MacLin, and MacLin, 2014; Eden, 2004; Nesbit and Adescope, 2006). However, 
despite all this diversity, cognitive maps, as a rule, tend to be considered more as a convenient tool for 
thinking than a tool for understanding the psyche. Such understanding exists despite the fact that it is 
cognitive maps, due to their projective nature, that allow us to present internal thought processes in an 
external form that is accessible to the researcher (Solso, MacLin, and MacLin, 2014; Nesbit and Adescope, 
2006). This also applies to the manifestations of the unconscious and, most importantly, the interaction of 
conscious and unconscious processes of the human psyche. Many questions of this interaction remain 
unclear, and it is largely unclear how the various manifestations of the conscious and unconscious relate 
to each other. The study of the ratio of verbal and nonverbal components of cognitive maps allow us to look 
deeper into the internal mental processes, to understand what conscious and unconscious mechanisms 
are involved in the implementation of thinking activity (Bottini and Doeller, 2020; Nanay, 2021). 

The first mention of this term was made by E. Tolman in 1948 (Tolman, 1948). His research was 
continued, at the level of human thinking in the work of R. Downes, D. Stey, (Downs and Stea, 2017). 
In this study, along with the concept of “cognitive map’, another one was used — “psychological map”. 
In general, a psychological map is a structured and ordered representation of reality, making it more 
concrete, but not reducible to model stimuli. 

Another similar term in terms of content is the “mental map” considered in line with the concepts 
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of K. Lynch, S. Milgram and S. Fauconnier (Filomena, Verstegen and Manley, 2019; Milgram, 1970; 
Fauconnier, 2018). By mental maps, these researchers meant an image of how a person imprints the 
object world around him in his mind (Milgram, 1970; Beel and Langer, 2011). 

In the future, the term “cognitive map” was interpreted more and more broadly, in the form of 
a metaphor for a certain set of ideas. So J. L. Bellmund defines the cognitive map as a set of visual 
representations of reality, a kind of mental images as such (Bellmund et al., 2018). Subsequently, the 
idea of cognitive maps as exclusively visual representations is questioned. A number of researchers are 
beginning to perceive it more as a conceptual scheme. In this capacity, under the name “concept map’, it 
was first described by J. Novak. It is presented as a technique of visual representation of the information 
structure, which reflects the interaction of concepts in the conceptual field (Novak, 2010; Cafias, Novak 
and Reiska, 2015). Further development, but already under the name of the intellect map or mind map, 
the conceptual map was received in the works of T. Buzen, which in his view is a graphic representation of 
semantic, causal or associative connections between concepts, parts and components of the considered 
area (Behrens, et al. 2018; Sadoski and Paivio, 2013). Thus, the cognitive map, along with the nonverbal, 
imaginative dimension, has a second — verbal dimension, and the problem of the interaction of these two 
components in the human psyche arises. 

One of the first works devoted to the problem of the correlation of verbal and nonverbal forms in 
the dynamics of thinking activity was the work of A. Paivio. In his research, he came to the assumption of 
the existence of two coding systems — figurative and symbolic (Sadoski and Paivio, 2013; Paivio, 2011). 

R. Finke, testing the hypothesis of A. Paivio, came to the conclusion that both codes can be 
implemented in human thinking activity either together or separately from each other (Ward, Finke and 
smith 2013; Palmiero, et al., 2019). 

The presence of psychic constructs confirms this possibility. Mental constructs are verbal concepts 
that construct the essence of the surrounding world (Palmiero, et al., 2019). According to N. Smith, the 
mental construct is a product of theorizing and abstraction, i.e., the complete opposite of the figurative 
representation of reality (Ward, Finke and Smith 2013). 

However, in their recent studies of mnemonic processes, A. Paivio and M. Sadoski, determined that 
when working with information, a person uses both methods of encoding. Initially, the incoming information 
is translated into figurative, and only then into verbal form, and in the case of abstract concepts, images 
act as “hints” that facilitate thinking activity (Sadoski and Paivio, 2013). 

The transition of symbolic processes into visual ones and, conversely, in cognitive maps Is often 
barely perceptible, and in most cases Is realized by a person on an unconscious level (Solso, MacLin and 
MacLin, 2014; Rosch, 2011; Park et al., 2020). 

R. McAleese, developing the ideas of P. Chandler, in a number of his articles, soeaks about the 
ability of a person, using cognitive maps, to be aware of the information received, extracting it from the 
unconscious, to clearly see the process of thinking (McAleese, 1998; Sweller, 2020). 

A number of researchers believe that the conscious and unconscious are not just different areas 
of the psyche, acting as repositories of thoughts and memories, they have different ways of interacting 
with the surrounding reality (Sadoski and Paivio, 2013; Dehaene et al., 2014). In this case, we can 
already talk about the cognitive conscious and the unconscious. These terms, introduced into scientific 
use by P. Rozin back in 1976, are still not well established. The idea of the cognitive unconscious was 
developed by S. Epstein, and later by a number of other specialists in cognitive psychology (Epstein, 
2012). To date, the cognitive unconscious is understood as the processing of information that occurs in 
addition to thought, bypassing consciousness. B. Baars generalized the ideas of S. Epstein and a number 
of other cognitive psychologists, created the theory of the global workspace. According to B. Baars, 
consciousness arises from the unconscious or preconscious, forming a global workspace (Baars, 2017). 
Cognitive neuropsychologist S. Dehaene, while studying the mechanisms of translation from unconscious 
perception to conscious perception, came to the conclusion that all events that occur in consciousness 
must initially occur in the unconscious and have a nonverbal form (Dehaene, 2011; Dehaene et al., 2014). 
D. Stern emphasized that the basis for the unconscious is nonverbal thinking, based on the language of 
images, and the basis of conscious Is logical-verbal thinking, operating with verbal representations (Stern, 
2015). A. Dijksterhuis, after a series of experiments, came to the conclusion that since a significant part of 
memory is unconscious, unconscious thinking is superior to conscious thinking in those areas that require 
a qualitative, simultaneous comparison of many alternatives (Dijksterhuis and Aarts 2010). Consequently, 
beyond the boundaries of consciousness are phenomena that are not subject to verbal processing, but are 
processed at the nonverbal level, forming the sphere of the cognitive unconscious. Of course, conscious 
is not limited to the verbal form, just as the unconscious is not limited to nonverbal forms. However, the 
verbal for conscious, as well as the nonverbal for the unconscious, are an absolute basis, as confirmed by 
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numerous studies in cognitive psychology, psychophysiology, and neuropsychology (Sadoski and Paivio, 
2013; Dehaene, 2011; Stern, 2015; Behrens, et al. 2018). 

Thus, the process of interaction of the verbal and nonverbal components of the subject's thought 
processes in the cognitive map makes it possible to trace how the unconscious component of the psyche, 
which Is reflected in the visual form, interacts with the conscious component, which reflects the verbal and 
logical component of the psyche. 

The study of such transitions in cognitive maps at the level of joint activity allows us to study it 
in a manifest, external form, whereas in individual activity, phenomena are inaccessible to an external 
observer, because of their convolution and non-manifestation in an external, observable form. 


Materials and Methods 


The study involved 80 subjects (24 men and 56 women) aged 20 to 24 years. Subjects — bachelors 
of the 3-4 courses and masters of the 1 course (humanities and technical specialties) of Don State 
Technical University. 

In the course of the study, each student group was asked to divide into subgroups of four people 
each, based on their personal preferences. A total of 20 small groups were obtained. 

The formed groups of subjects were given four tasks. Half of the groups of subjects received 
the first and second tasks to solve, the second half of the groups were given the third and fourth tasks. 
This was done to ensure that the subjects solved the most different problems from each other, and the 
experience of solving one problem did not affect the solution of the other. In addition, half of the subjects 
solved the problems without having a time limit. The other half, had to meet a certain time frame, when 
solving problems. This was done to stimulate the unconscious component of thinking, which increases 
with a decrease in the resource of time. 

The first of them was to remove a certain number of lines that make up the sides of a square and 
add a certain number of lines in return, to get a different number of squares than what was originally 
presented in the conditions of the problem. You need to find only one option that fully meets the conditions 
of the problem. To facilitate the thought process, Its greater clarity, the squares were assembled from 
matches. The second task was to find a way to break a vase full of water, located in a locked room, without 
leaving a trace, while being in the building opposite. In this case, it was necessary to offer all possible 
ways that guaranteed success. The third task asks the subjects to draw three straight lines, through four 
points arranged in squares, without lifting the pencil from the sheet of paper so that all the points are 
connected, and the pencil returns to the starting point. It was necessary to find all possible ways to do 
this. The fourth task is about two twins, one of whom must be caught in a lie knowing that one of them 
always tells the truth, and the other always lies. It is necessary to find the only possible formulation that 
allows this to be done. 

Each of the proposed tasks has a certain combination of parameters. The first task is nonverbal 
in nature and has a single solution within the framework of the formulated conditions. The second task 
is verbal, having many ways to solve it. The third task is nonverbal in nature, and has many possible 
solutions. The fourth task is verbal in nature, also having only one solution. Thus, the four tasks are a 
combination of certain parameters highlighted as the main ones and allow you to alternately use certain 
components of the psyche. 

Thus, the verbal nature of the task inclines the subjects to engage in verbal-logical thinking, which 
is based on the conscious component of the psyche, while nonverbal tasks, on the contrary, promote 
the use of imaginative thinking and, therefore, rely more on the unconscious component of the psyche. 
The presence of provided alternatives in the results of solving the problem should also contribute to the 
activation of the conscious, If there are several possible solutions or activation of the unconscious, the 
latter better copes with the need for a qualitative comparison of alternatives among themselves, to choose 
the only way to solve the problem. 

Before working with the tasks, all the subjects were informed whether the task has one or more 
solutions. 

After solving all the problems, students were asked to individually depict the process of group 
solving one of the four problems in a graphical form. Each of them could represent the solution of only 
one problem. Students were not required to seek help from other members of the group. Before starting 
work, the study participants had to agree with each other on the solutions to which problem they would 
represent. This was done to get an equal number of images for each of the presented tasks. At the same 
time, those subjects who solved problems in the presence of time constraints were instructed to build 
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a cognitive map for a certain period of time, equal to three minutes. This was done so that the study 
participants did not have time to create a conscious plan for the future map and were forced to rely on 
the unconscious component of the psyche. The other half of the subjects did not have such restrictions, 
and could more consciously approach the creation of a cognitive map. Thus, ten cognitive maps were 
obtained for each of the tasks. 

The drawn image created by the student could have explanations in the form of individual words 
or short phrases. Assignments for students were submitted in a free form, with high uncertainty. Thanks 
to this, the construction of cognitive maps was made less formal, which contributed to a more flexible 
approach to their representation and allowed us to overcome the limitations of focusing on the formal 
criteria of cognitive maps. The resulting cognitive maps were evaluated according to four indicators. 

The first such indicator was figurative abstractness, understood as the presence of images distant 
from specific images. The number of abstract images was taken into account, the more of them, the 
higher the abstractness of the cognitive map. The presence of 25% or less of abstract images from the 
total number in the drawing indicated a low abstractness. From 25% to 50% of abstract images meant that 
the map has an average level of abstractness. If such images were from 50% to 75 %, the abstractness 
of the cognitive map was defined as high, more than 75 % as very high. Thus, a particular cognitive map 
could get from 1 point for low abstractness to 4 points for high abstractness. 

The second indicator was symbolic abstractness, understood as the degree of remoteness of the 
verbal component of the map from specific concepts. The method of evaluation was the same as in the 
first case. 

The third indicator is imagery (nonverbality), defined as the number of images used in the cognitive 
map. The number and method of awarding points was the same as in the case of the previous indicator. 

The fourth indicator is symbolism (verbality). This is the number of verbal objects in the cognitive 
map. If the number of words did not exceed 4, then the symbolism was determined as low and was 
indicated by one point. The cognitive map, which included from 5 to 8 words, was defined as having an 
average level of symbolism, which brought 2 points. A map in which from 9 to 12 objects were determined 
to have a high level and were rated at 3 points. Amap with more than 12 objects was defined as having a 
very high level of symbolism, which was estimated at 4 points. 

Mathematical and statistical data processing was performed using the Kruskal-Wallis H-test, the 
Mann-Whitney U-test, and the Friedman chi-square test. 


Results 


The indicators of cognitive maps were brought to the average values for each of the four tasks. 
The results obtained are divided into five main blocks. The first section provides data on the differences 
in each individual indicator of cognitive maps based on the results of solving all types of tasks, by those 
subjects who were not limited in time when creating these maps. The second section provides data on the 
differences between all the indicators of cognitive maps, performed as a result of solving each individual 
type of tasks, by subjects who were not limited in time when creating these maps. The third section 
provides data on the differences in each individual indicator of cognitive maps based on the results of 
solving all types of tasks, by those subjects who were limited in time when creating maps. The fourth 
block provides data on the differences between all the indicators of cognitive maps, performed as a result 
of solving each individual type of tasks, by subjects who were limited in time when creating maps. The 
fifth block demonstrates the results of the study on the presence of differences between the indicators 
of the cognitive maps of the subjects who were limited in time, and those for whom there were no such 
restrictions. To obtain the results of the first and third blocks, the Kruskal-Wallis H-test was used. To obtain 
the results of the second and fourth blocks of the criterion, the Friedman chi-square was used. To get the 
results of the fifth block, use the Mann — Whitney U-test. 

Table 1 shows the results of a study of the differences between the indicators of cognitive maps 
performed after solving all four tasks, without time limits. 
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Table 1 
Differences in each individual indicator of cognitive maps performed without time constraints, based 
on the results of solving all types of tasks 
Indicators of cognitive maps 


Figurative Symbolic Imagery Symbolism 
Types of tasks abstractness abstractness 
Average Difference Average Difference Average Difference Average Difference 
values Indicator values Indicator values Indicator values indicator 
Task 1 
Nonverbal, with one 29 16 3,4 22 
solution option 
Task 2 
Verbal, with multiple 1.6 19 2,1 3,1 
solutions 
Task 3 13,8/** 3,21 19,31** 10,32" 
Nonverbal, with 2.0 2,0 Zt 3,0 
multiple solutions 
Task 4 
Verbal, with one so- 2.0 16 ? 1 ? 1 
lution option 


Note: **p<0,001: **p<0,01: *p=0,05 


According to the presented data, significant differences obtained using the Kruskal-Wallis H-test 
were found between such indicators of cognitive maps as figurative abstractness (hemp.=13.87; p < 0.01), 
imagery (hemp.=19.31; ps0.01) and symbolism (hemp.=10,32; ps0,05). At the same time, the subjects 
showed the highest indicators of figurative abstractness of cognitive maps when solving the first task 
(2.9), which has a nonverbal character and is limited to one correct solution. The imagery of the cognitive 
map was the highest, according to the results of solving the first problem (3.4), as well as in the case of 
figurative abstraction. The highest indicators of the symbolism of the cognitive map are demonstrated 
by the subjects after solving the second task — verbal, with several solutions. The differences in such an 
indicator as symbolic abstractness were insignificant. 

Cognitive maps based on the results of verbal tasks are inferior in figurative abstractness and 
imagery to maps made after solving nonverbal tasks. The figurative abstractness is higher in those maps 
that were created based on the results of solving a problem with one correct answer. High levels of 
symbolism are demonstrated by those cognitive maps that were created as a result of solving problems 
with multiple solutions, whether they were verbal or nonverbal. The index of imagery is higher in those 
cognitive maps that were created after solving problems with one correct answer, but they were higher 
after solving nonverbal problems than after solving verbal ones. 

After describing the results of comparing the indicators of cognitive maps performed on the basis of 
different types of tasks, we will consider the data on the differences between all the indicators of cognitive 
maps performed on the basis of solving each individual type of tasks. The results are presented in table 2. 
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Table 2 


Differences between all indicators of cognitive maps performed without time constraints, based on 
the results of solving each individual type of task 


Task 1 


Indicators of Nonverbal, with one 


cognitive maps 


Types of tasks 


Task 2 


Verbal, with multiple 


Task 3 


Nonverbal, with mullti- 


Task 4 


Verbal, with one 


solution option solutions ple solutions solution option 
Average Difference Average Difference Average Difference Average Difference 
values indicator values indicator values indicator values indicator 
Figurative 
2,9 7,6 2,0) 2,0 
abstractness 
symbolic 
7,6 7,9 2,0) 1,6 
abstractness 
16,64** 14,66** ae 443 
imagery 3,4 2,1 raed Z1 
symbolism ad aot 3.0 f1 


Note: ***p=0.001- **p<0,01: *p<0,05 


According to the presented data, significant differences established using the Friedman chi-square 
test were found between the indicators of cognitive maps that were performed based on the results of 
solving the first (Vr emp.= 16.64; ps 0.01) and the second task (7remp.= 14.68; ps 0.01). Among the 
indicators of cognitive maps performed at the end of the first task, imagery is predominant (3,4). At the 
same time, high values for figurative abstractness (2.9) indicate the predominance of abstract images 
in maps that are based on nonverbal tasks, with one possible solution. The indicators of symbolism 
(2,2) and symbolic abstractness (1,6), on the contrary, are relatively small. In addition, the low values of 
symbolic abstractness indicate the predominance of the nonverbal component of the cognitive map over 
the verbal one, in such maps, there are many specific concepts and few generalizations. The indicators of 
cognitive maps performed on the results of the second task demonstrate the predominance of symbolism 
(3,1) over imagery (2,1). Indicators of abstractness of both symbolic (1,9) and figurative (1,6) are at a low 
level. These cognitive maps are dominated by verbal objects — verbal descriptions that are specific in 
nature. The nonverbal component is noticeably weaker, the images themselves are concrete and inferior 
in abstraction to the symbolic component. 

Consider the results of the second group of subjects who, according to the study conditions, had to 
create cognitive maps with time constraints. The results are presented in Table 3. 
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Table 3 
Differences in each individual indicator of cognitive maps performed under time constraints, based 
on the results of solving all types of tasks 


Indicators of cognitive maps 


Figurative symbolic imagery Symbolism 
Types of tasks abstractness abstractness 
Average Difference Average Difference Average Difference Average val- Difference 
values indicator values indicator values indicator ues indicator 
Task 1 
Nonverbal, with one 3.3 1.8 3,5 2,6 
solution option 
Task 2 
Verbal, with multiple 1,6 2,8 2,0 Fay | 
solutions 
Task 3 16,03** 13 19,80** 182" 
Nonverbal, with 2.9 1.7 2,3 1.6 
multiple solutions 
Task 4 
Verbal. with one $0- tS 75 1 = 1.7 
lution option | 


Note: ***p<0,001: **p<0.01- *p<0,05 


In the second group of subjects, significant differences obtained using the Kruskal-Wallis H-test were 
found among all four indicators of cognitive maps: figurative abstractness (hemp.=16.03; ps0.01), symbolic 
abstractness (hemp.=11,31; ps0,05), imagery (hemp.=19.80; ps0.01) and symbolism (hemp.=7,82; 
o<0,05). The highest indicators of figurative abstractness (3.3), figurativeness (3.5) and symbolism (2.6) 
are demonstrated by cognitive maps based on the results of the first type of tasks — nonverbal, with one 
possible solution. The highest indicators of symbolic abstraction (2.8) were demonstrated by the subjects, 
creating cognitive maps, based on the results of solving the second type of problem — verbal, with several 
possible solutions. 

The indicators of the figurative abstractness of the cognitive maps performed on the results of 
nonverbal tasks significantly exceed the indicators of verbal tasks. Cognitive maps based on problems 
with multiple solutions are inferior in this indicator to problems with a single solution. At the same time, 
the largest gap in the index of figurative abstractness Is observed between cognitive maps created on the 
basis of verbal and nonverbal tasks. 

High symbolic abstractness, on the contrary, is typical for verbal tasks. However, the results in 
terms of symbolic abstractness are slightly higher for cognitive maps based on the results of solving 
problems with multiple solutions. 

The high rate of imagery that the cognitive map demonstrates is based on a nonverbal task with 
one solution option, which is not typical for other types of tasks. Cognitive maps based on the third task, 
despite its nonverbal nature, show a significant decrease in the indicators of imagery, but at the same 
time, according to these indicators, they are superior to cognitive maps made on the basis of verbal tasks. 

A higher symbolism is observed in a map that displays a nonverbal problem with one solution, 
compared to maps made on the basis of verbal problems with several solutions. However, for verbal tasks, 
the opposite picture is observed. Cognitive maps based on such tasks show high rates of symbolism in 
the case of several solutions to it. 

Now we shall look at the data on the differences between all the indicators of the cognitive maps 
performed based on the results of solving each individual type of tasks, with time constraints. The results 
are presented in table 4. 
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Table 4 
Differences between all indicators of cognitive maps performed under time constraints, based on 
the results of solving each individual type of task 


Types of tasks 


= ‘ Task 1 Task 2 Task 3 Task 4 
icat 
g ea oo Nonverbal, with one Verbal, with multiple Nonverbal, with Verbal, with one 
cognitive maps ; ; ; 
solution option solutions multiple solutions solution option 


Average Difference Average Difference Average ODifference Average Difference 


values indicator values indicator values indicator values indicator 

Figurative 

3,3 16 29 29 
abstractness 
Symbolic 

18 28 17 25 
abstractness 

16,64"* 14,60" 595 4 43 

imagery 3,5 2,0 ie 15 
symbolism 2,5 2,1 16 Le 


Note: **p<0,001; **p=<0,01; *p<0,05. 


According to the presented data, significant differences established using the Friedman chi- 
square test were found between the indicators of cognitive maps that were performed based on the 
results of solving the first (ZY 2r emp.=15.519; p < 0.01), the second (7’remp.=7.82; p<0.05), the third 
(7*remp.=10.03; ps0.05) and the fourth (7V2remp.=8.45; p<0.05) tasks. 

The cognitive maps that were completed on the results of the first task are expected to have the 
highest values of imagery (3.5) and figurative abstractness (3.3). In such maps, the main information Is 
represented by nonverbal objects of a high level of abstraction, the verbal component is represented 
to a less extent (2,6), and its abstractness Is relatively low (1,8). Among the cognitive maps completed 
as a result of the second task, the symbolism (2,1), representing the verbal component, only slightly 
exceeds the imagery (2,0) as a verbal component of the maps. However, symbolic abstractness (2,8) is 
significantly ahead of figurative abstractness (1,6). In these maps, the verbal and nonverbal components 
are represented quantitatively in almost equal proportions, but qualitatively differ significantly, using mainly 
abstract concepts, against the background of specific images. The indicators of cognitive maps performed 
on the results of the third task demonstrate the predominance of imagery (2,3), over symbolism (1,6) and 
figurative abstraction (2,9), over symbolic abstraction (1,7). In such maps, the verbal component has a 
fairly significant predominance over the nonverbal component, with a significant abstraction of images 
and concreteness of the concepts used. The cognitive maps performed on the results of the fourth task 
demonstrate the predominance of symbolism (1,7) over imagery (1,5) and symbolic abstraction (2,5), over 
figurative abstraction (2,2). In these maps, the predominance of the verbal component over the nonverbal 
one Is pronounced weak, and the degree of abstractness of the concepts used is relatively high, with 
average indicators of the abstractness of images. 

The results of the study of the first and second groups of subjects allow us to compare the indicators 
of the cognitive maps performed in each of them, in order to find differences between them. The calculation 
of the Mann-Whitney U-test showed the following statistically significant differences between the groups 
in terms of cognitive maps: between the indicators of figurative abstractness in solving the third Uemp 
problem. =21.5; ps0.05; between the indicators of symbolic abstractness in solving the second Uemp 
problem.= 20.0; ps0.05; between the indicators of symbolic abstractness in solving the fourth Uemp 
problem.=21.5; ps0.05; between the indicators of imagery in solving the fourth Uemp problem.=25.5; 
p<0.05; between the symbolism indicators when solving the second Uemp problem.=16.5, ps0.01; 
between the symbolism indicators when solving the third Uemp problem. =11.0; ps0.01; 
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Discussions 


It can be assumed that working with a nonverbal task with one correct solution and no time limits 
was perceived by the participants of the collaborative thinking activity primarily at the nonverbal level. 
This was evidenced by the high rates of imagery and significantly lower rates of symbolism of cognitive 
maps. At the same time, the images used in the thought process were of a generalizing, abstract nature. 
This is evident in the high levels of figurative abstractness of cognitive maps. The indicators of symbolic 
abstractness, on the contrary, are quite low. Consequently, in the process of solving this type of problem, 
the verbal component of thinking was concrete, describing the immediate moments of the thought 
process. This seems to be due to the auxiliary role played by the verbal component of thinking in this case. 
Abstract images made it possible to work with a large number of ideas that arose in the process of solving 
the first problem, without having to translate them into verbal form. According to research of S. Deana, 
when working with information flows, the unconscious translates nonverbal images into conscious, which 
are realized by the person as necessary (Dehaene, 2011; Dehaene et al., 2014). Due to the nonverbal 
nature of the task being solved, the translation of a significant part of the information into verbal form was 
unnecessary. The presence of a certain number of specific words, reflected the final moment of thinking. 
When the participants of the discussion shared their already formed idea with each other. 

Working with a verbal task that has one correct solution and no time limit demonstrates a slightly 
different picture of thinking activity. According to the low indicators of figurative and symbolic abstractness, 
the thought process of solving the fourth problem was more concrete than the first one. Apparently, 
the solution of this problem, almost equally involved both the verbal and nonverbal components of the 
psyche, which can also be seen in the average indicators of imagery and symbolism. When comparing 
different options for possible solutions to a problem where only one method is correct, finding such a 
method requires significant time and effort. Indeed, finding one of the many correct solutions to a problem 
is statistically easier than finding a single solution. When finding the only correct solution, you need to 
go through and analyze more options than when finding one of several correct solutions. Apparently, 
therefore, the problem of speed comes to the fore of thinking activity. In this case, the problem of the speed 
of thinking was solved by shifting the thinking activity towards the nonverbal unconscious component, as 
shown in the research of A. Dijksterhuis (Dijksterhuis and Nordgre, 2006). However, the verbal nature of 
the task prevented them from fully switching to image manipulation, and their thinking activity was forced 
to balance between their verbal and nonverbal components. 

When working with a verbal and nonverbal task that has several solutions, the verbal component 
of thinking, in the subjects, clearly prevails over the nonverbal, which is noticeable by the increased 
indicators of the symbolism of cognitive maps. At the same time, figurative abstractness increased when 
solving nonverbal tasks, while symbolic abstractness remained at an average level. It did not differ much 
in the cognitive maps drawn from the results of verbal and nonverbal tasks. This seems to be a reflection of 
the freer, more creative nature of thinking activity in this case. The subjects had to make a choice between 
several possible solutions, some of which had obvious signs of the correct solution. In such circumstances, 
it may be necessary to consciously pay attention to the details of possible solutions, pronouncing them 
for yourself and others, which increases the verbal component of thinking. The results obtained are in 
many respects similar to the data of the experiments of A. Dijksterhuis and H. Aarts (Dijksterhuis and 
Aarts 2010). Although these researchers claimed that it is the unconscious that is better suited to solve 
creative problems, they did not deny that with alternative solutions, the conscious component of the 
psyche may be more effective. Participants could pay more attention to the discussion of various ideas, 
compare several correct solutions among themselves, find the best alternative by such a comparison; at 
the same time, being not limited to strict requirements for the result of the decision. Taking into account the 
activating function of positive gnostic emotions, which are typical in this case, this approach allowed us to 
talk more about possible ways to achieve results, express original ideas more freely, and concretize them 
at the verbal level (Belousova and Belousova, 2020). The increase in the index of nonverbal abstractness 
in nonverbal tasks can be explained by the need to reflect the nonverbal component of the task, which Is 
of a secondary nature in the verbal task. 

The thinking features demonstrated by the subjects when working on a nonverbal problem with 
one solution that has time constraints are generally similar to the thinking features of the subjects when 
solving the same problem that does not have time constraints. The reduced use of words in general 
and abstract concepts in particular seems to have reduced the time needed to formulate them, as it 
did when solving problems in groups without time constraints. However, these indicators were higher 
in groups with time constraints. Due to this, it became possible to increase the value of the nonverbal 
component of thinking. It can be assumed that it was the temporary pressure on the groups that led to 
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these features of the manifestation of thought processes. The data obtained correspond to the results of 
a series of experiments by M. Strick, L. F. Nordgren and R. B. van Baaren, which confirm the idea that 
the unconscious Is able to perform more mental operations than conscious, thereby accelerating thought 
processes (Strick et al., 2011). This strengthening of the cognitive unconscious contributed to an increase 
in the share of images and abstract concepts in thinking and made it difficult to translate them into a 
verbal, fully conscious form in the future. 

When working with a nonverbal task that has several solutions with a time limit, the subjects’ 
thinking shows a decrease in imagery, compared to solving a problem with one solution, but exceeds this 
indicator when solving verbal tasks. This suggests that the presence of several options for solving the 
problem, with its nonverbal nature, reduced the overall intensity of thinking activity. The relative ease of 
finding one of several solutions, compared to the need to find the only correct solution, and the nonverbal 
nature of the task itself, which made it difficult to exchange opinions in a group, made the picture of 
thinking less rich in images and concepts. 

The relatively high symbolic thinking of the subjects who worked on a verbal problem with multiple 
solutions and time constraints, compared to the maps made on the basis of a problem with a single solution, 
indicates a reliance on verbal mental processes, with their ability to abstract and generalize. However, 
due to the relative slowness of the verbal manifestations of thought processes, the use of images gives 
an advantage in speed. According to the theory of the global workspace of B. Baars, thought processes 
individually work unconsciously (Baars, 2017). However, in order to form a general picture of what is 
happening, their interaction becomes conscious. |In this case, the need to work on different alternatives to 
solving the problem under time constraints led to the need to simultaneously quickly search for different 
solutions (using the nonverbal, unconscious component of thinking) and simultaneously integrate the 
results of these solutions into the overall thought process (using the verbal, conscious component of 
thinking). This in turn increases the abstractness of symbolic thinking and makes the differences between 
the indicators of symbolic and figurative abstractness based on verbal tasks more significant than the 
differences in the indicators of figurative and symbolic thinking. 

The differences between the indicators of thought processes implemented without time constraints 
(the first group) and thought processes implemented with time constraints (the second group) indicate 
the pressure of the time factor that the thinking of the subjects from the second group experienced. They 
are more likely than the subjects of the first group to use abstract images and concepts in their thought 
processes, but in general they use symbols and images in a less balanced way, which is why, as a rule, 
there is a clear predominance of either one or the other in their thinking. Subjects from the first group 
are more inclined to use specific words and images in their thought processes, tend to build complex 
structures, and prefer to adhere to approximately equal use of the verbal and nonverbal components in 
their thought processes. 


Conclusions 


The results obtained in the study make it possible to see the direct interaction of verbal and 
nonverbal components of thought processes and indirectly observe the dynamics of relations between 
the conscious and unconscious components of the psyche. 

Based on the data obtained, the following conclusions can be drawn: 

1. Under the conditions of time constraints, the tendency to use abstract images in thinking activity 
increases significantly, when the conscious, not having time to formulate thoughts clearly enough in a 
verbal-logical form and subject them to verbal processing, gives way to the unconscious, which processes 
information on a nonverbal level and is able to give the necessary description on the basis of unclear, 
generalized images. 

2. When solving nonverbal tasks with time constraints, the use of abstract concepts increases, while 
in the absence of time pressure, the use of abstract concepts is inferior to the use of abstract images. In 
the conditions of lack of time, the differentiation of the implementation of verbal and nonverbal processes 
in thinking activity increases due to the difficulties of double encoding, when the verbal component of 
thought processes ceases to have time to decipher the nonverbal images generated by the unconscious 
component of the psyche, and Is forced to separate from tt. 

3. The symbolism of thinking processes in solving verbal problems with multiple solutions is higher 
than in such problems with a single solution. A large number of solutions to these problems increases the 
activity of the verbal component of thinking. When solving a nonverbal problem with one correct answer, 
on the contrary, the imagery of thinking activity in the psyche is higher than when solving a nonverbal 
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problem with multiple solutions, which can be explained by the ability of the nonverbal component of 
thinking to unconsciously conduct a quick search of solutions. Therefore, when thinking about a large 
number of alternatives with the help of verbal and logical thinking, a person Is aware of and, consequently, 
displays a lot of objects of his thinking activity, which increases the symbolic component of his\her ideas 
about it. On the contrary, when working with nonverbal elements, imaginative thinking is involved in 
the analysis of many alternatives, most of them he\she simply does not realize and only when working 
with one solution, even in a nonverbal form, enough objects are displayed in the psyche to give a fairly 
complete description of the imaginative thought processes. 

4. The figurative component of thinking, prevails over the symbolic, in thinking activity, when solving 
both verbal and nonverbal tasks. At the same time, the imagery of thought processes when solving 
problems with one answer is higher than with many, and when solving nonverbal problems, it is higher 
than verbal ones. This is due to the fact that thinking activity relies on the language of images, which are 
then translated into verbal representations. 
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Abstract: Purpose of this paper is to determine how students perceive the image of their faculty on social networks, 
but also to analyse their experience and attitudes towards faculty social media strategy. The research was implemented using 
descriptive statistic techniques, as well as non-parametric tests such as Mann-Whitney U Test, Kruskal-Wallis H Test and 
Spearman's Rho. The most common source of information when it comes to enrolment to faculty is word of mouth, while social 
media have a significantly lower credibility. During their schooling the respondents have most confidence in the official website, 
and far less in social networks. Such findings signalize the necessity of creating an adequate digital marketing strategy that 
can significantly improve the perceived faculty image. Positive perception of the image is fundamental for understanding the 
process of searching for and selection of the faculty, especially since the results have shown that the students do not value 
highly the image their faculties have on social networks. Positive perception of faculty image mostly depends on promotion 
strategy on Facebook and Instagram, and far less on LinkedIn and Twitter. In addition, students value more the image of the 
faculty whose social network profile they follow and, in a case, when they are followed back. No correlation was found between 
faculty image and gender, age or average grade. Therefore, we can conclude that social networks are very important in creating 
positive image and thanks to new technology, they are a promising solution for differentiation from competition in digital space. 

Keywords: student's perception, attitudes, faculty image, social networks, tourism and hospitality faculty. 


Introduction 


Over the last few years, the higher education sector has experienced accelerated market changes, 
which has led to the development of numerous customer-driven marketing strategies as well as recruitment 
processes. These changes primarily occur thanks to the millennial generation, who know and use the 
internet very well (Hesel and Williams, 2009) demonstrating a strong need and desire to connect with 
other people and cooperate with them (Lindbeck and Fodrey, 2010). Smith (2011) as well as Milicevic, 
Petrovic, and Dordevic, (2020) state that the competitiveness of higher education institution should derive 
from the opportunities students have to access all the information they need very quickly and easily. 

Kaplan and Mazurek (2018) define social media as a group of Internet-based applications that allow 
the users to exchange the content and to participate in interactive communication. Social media provide a 
very easy way for organizations to connect with the existing and future clients, as well as other interested 
stakeholders (Nyangau and Bado, 2012; Minocha, 2009). Social media are especially important marketing 
tools for higher education institutions (HEI) (Constantinides and Zinck Stagno, 2011). Higher education 
institutions mostly use the following social media: social networks (such as Facebook and Instagram), web 
platforms for online video sharing (such as YouTube and Snapchat), blogs (like Twitter), business-oriented 
online services (such as LinkedIn), Internet forums, etc. (Mazurek, Korzynski and Gorska, 2019). In 
particular social media are becoming very important for students (Tezer, etal., 2017). Eldegwy, Elsharnouby 
and Kortam (2018) state that social media enable interactive communication between students, as well 
as between the students and the employees of higher education institutions, which overall contributes to 
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their positive experience during studies. For example, existing university students share information and 
their experiences about studying in social media platforms, which may contribute significantly to new 
students (De Silva and Rossi, 2018). Facebook is the example of the social network that is most accepted 
by students as it provides them with easy and fast communication with the higher education institution 
(Roblyer et al., 2010). 

Numerous authors define the organizational image in differentways.According to Kuguksuleymanoglu 
(2015) organizational image is the sum of thoughts and perceptions created in the minds of key 
stakeholders about the organization and its constitutive elements. Organizational image refers to people's 
impressions of an organization and is defined as people’s loose structures of knowledge and beliefs about 
an organization (Lievens, 2017). Van Riel and Fombrun (2007) state that organizational image comprises 
of all the interpretations the stakeholders make about an organization. Image is an immediate stakeholder 
perception founded on impressions toward the organization (Heding et al., 2009; Huang and Lien, 2012). 
In general, the definitions of organizational image take into consideration a cognitive element based on 
the group of perceived beliefs or attributes of the organization (Perez and Torres, 2017). 

In scientific publications, one can find research by numerous authors regarding the organizational 
image of higher education institutions. Organizational image of a higher education institution is a perceived 
image that the public has toward the institution according to their interests and personal experiences 
(Nguyen and LeBlanc, 2001). Organizational image is an important issue for many higher education 
institutions due to the competitive environment that conditions a significantly higher level of service quality 
(Perez and Torres, 2017). It is an important factor to attract and retain the best domestic and foreign 
students and prestigious professors (Drydakis, 2015; Faham et al., 2017; Kheiry et al., 2012; Polat, 2011). 
In other words, the institutional image has a direct impact on students’ value perception, satisfaction and 
loyalty and it is a very important tool to attract new students (Brown and Mazzarol, 2009; Elsharnouby, 
2015). 

To create a successful image of a higher education institution, it is very important to consult the key 
stakeholders, and accordingly choose the most appropriate communication strategy (Kuguksuleymanoglu, 
2015). Numerous authors in their research have analyzed relationships among student's perception and 
image of higher education institutions (Alves and Raposo, 2010; Pampaloni, 2010; Sung and Yang, 2008). 
Kucuksuleymanoglu (2015) states that the students’ perceptions of the image of the faculty depend on 
their gender, their socio-cultural activities and their achievements during studies. The results of the 
research conducted at Australian universities show that the image of the faculty is of great importance for 
the students, regardless of the students’ age (Brown and Mazzarol, 2009). 

Institutional image is usually created as the result of the interplay between two elements, as 
an integration of the information presented by the higher education institution and the communication 
instruments (Mackelo and Driteikiené, 2010). Some researchers indicate that the organizational image of 
a higher education institution consists of a great number of factors, such as: previous reputation, facilities, 
courses popularity, atmosphere, tuition fees, professors, theoretical—practical approach, communication 
between students and professors, number of students and marketing efforts in the online environment 
(Fransen and Van Rompay, 2011; Galiniene et al. 2009; Stefko et al., 2015). 

According to Simoes and Soares (2010) the Internet has significantly changed the way students 
obtain information about higher education institutions. Communication becomes more virtual, digital, 
online, but its purpose remains the same (Garabinovic, 2019). Online environment offers higher education 
institutions various marketing strategies that facilitate the placement of a lot of information and enable 
two-way communication with the existing and future students (Alexa, Alexa, and Stoica, 2012). A well- 
designed institution's website leads to a positive perception toward the higher education institution, 1.e., 
becomes a dynamic marketing tool to attract students (Foroudi et al., 2019). 

The main objective of the study is to determine students’ perception towards the image of the 
faculty on social networks. Also, this paper examined their attitudes and experience regarding faculty 
social media strategy. Beside this, in the research focus, is impact of social networks on recruiting new 
students and comparison of faculty usage of traditional communication with a communication trough 
social network. 


Literature review 


In the last few years higher education (booth vocational and academic ones) has become one 
of the fastest-growing service sectors (Alwi and Kitchen, 2014) which has contributed to the spread of 
knowledge and the development of society (Council of Europe, 2019). This trend is followed by more usage 
of social networks for reaching out new students as well as by dominating digital marketing strategies 
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over traditional ones (Bamberger, Bronshtein, and Yemini, 2020). Benefits that these networks offer are 
numerous. First of all, lower expenditures of promotion, high effectiveness in communication and reaching 
audience, institution comparison based on their online image, a large number of users, interactivity, 
adaptiveness and availability (Bednar, 2013; Kelleher and Sweetser, 2012; Kumar and Nanda, 2019; 
Kumar and Nanda, 2020; Manca and Ranieri, 2016). Social networks made new relationships with future 
and existing students, throughout fostering their engagements through likes, comments, and shares of 
a post (Bamberger, Bronshtein and Yemini, 2020; Brech et al. 2017; Kelly, Kerr, and Drennan, 2010; 
Pucciarelli and Kaplan, 2016). Designing scalable learning system based on student preferences Is the 
future of HEI’s (Kuzmanovic et al. 2019). 

Barnes and Matson (2010) investigated usage of social media in U.S. higher education and they 
found that the most popular is Facebook, which they use for attracting students, while Twitter was on the 
second place. Slover-Linett and Stoner (2011) analysed data collected from 1,000 universities worldwide, 
and concluded that most institutions used Facebook (94%), on the second place were Twitter, LinkedIn, 
and/or YouTube. Kuzma and Wright (2013) explored usage of social networks among 90 universities 
in Africa, Asia and Europe, where results indicate Facebook and LinkedIn are the most represented in 
all locations, especially Facebook with 77% to 94% usage for marketing purpose, while others (Twitter, 
MySpace and YouTube) vary in different countries. Most of the universities are using predominantly global 
social networks except in China, where the market is dominated by local ones. Beside growing number 
of networks, Peruta and Shields (2018), consider that Facebook is still the most powerful tool that can 
provide significant return on HE marketing investment through user generated content posted at right 
time. Research study of state faculties in Serbia and their visibility on social media has shown that they 
do not have clear social media strategy and that Facebook Is the most often used channel (Stevic, Vujicic, 
and Lalic, 2017). The latest investigation of Serbian HEI, has also shown the lack of usage of LinkedIn and 
Twitter, which may indicate that not all faculties have accounts on these networks (Vukic and Vukic, 2019). 

Beside their primary function such as communication, social networks can be a very powerful tool 
for teaching and learning purposes (Dyson et al., 2015; Ivanovic et al., 2018; Kumar and Nanda, 2020; 
Radovanovic, Hogan, and Lalic, 2015; Tess, 2013). In this respect, they foster creativity, discussions, peer 
learning, new learning experience, constructive feedback (Kumar and Nanda, 2020) and play a vital role 
in lifelong learning (Duggan et al., 2015). Social networks throughout digital lecture provide opportunities 
of unlimited access to extensive resources of knowledge (Powers et al., 2012), development of distance 
learning and open educational resources (McDougall, Readman, and Wilkinson, 2012). This way of 
interaction, allows students to feel more connected with university and their colleagues, with tendency to 
become alumni who will create a strong ecosystem. 

Quality HEl’s services have a positive impact on students’ satisfaction, which will affect their 
profitability (Duque, 2014). Therefore, it is very important to create an adequate brand image on social 
networks that will reflect all values that they offer. Furthermore, with an adequate image, it is much easier 
to attract international students and key stakeholders (Pucciarelli and Kaplan, 2016). This conclusion 
complements Merrill (2011) who states that the use of social networks improves promotion of institution, 
distribution of information, recognition of their brand, engagement of potential students, and valuable 
metrics and competitor practices. An adequate promotion of university brand on social networks can 
positively affect students’ decision-making process (Huynh and Nguyen, 2015) and also determine 
identities of all stakeholders such as prospective students, current students, graduates, and companies 
(Lafuente Ruiz de Sabando, Forcada Sainz, and Zorrilla Calvo, 2018). It is very important that students 
actively participate in the value creation process for brand image and reputation, as they have a more 
positive attitude toward the university and are more satisfied with their customer journey which brings 
more attachment to the university (Foroudi et al., 2019). Study conducted by Vogler (2020) shows that 
despite the crisis in journalism, news media provide credible knowledge and social media represent 
trustable sources for independent information about science. 

We can retrieve few conclusions from previous literature review. Most of the researches have 
focused on aspects such as: learning and teaching possibilities through social networks; social media 
Strategies, university brand image on social media and students’ satisfaction. Moreover, it can be 
concluded that HEls marketing and recruiting strategy cannot be imagined without social networks, 
especially Facebook, which is the most popular among students from all over the world. In addition to 
promotion, social networks enhance university prestige and status, which particularly affects international 
students, whose attraction can increase profitability. However, the main conclusion is, that there is lack of 
knowledge about how HEl’s image on social media affects students’ interest for enrolment, and authors 
found no previous research study regarding students’ perception of HEI image on social networks in 
serbia. Therefore, the results of this study provide a better insight into what affects the perception of the 
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image of the faculty on social networks and it can be used for making the image of the faculty better. 


Materials and Methods 


An empirical study was conducted to explore the students’ perception of faculty image on social 
networks, as well as their experience and attitudes toward faculty social media strategy. The study sample 
consisted of students who studied hotel management and tourism courses at the University of Belgrade 
and the University of Novi Sad, which included four faculties. The main research instrument in this study 
was an online questionnaire, which was distributed through faculties’ Facebook groups during summer 
semester of the 2019/20 academic year. 

The questionnaire was organized in three sections. The first section covered questions related to 
the demographics of the respondents. The second section was related to their experience and attitudes 
towards the faculty social media strategy. Statements regarding students’ perceptions of the faculty image 
On social networks were included in the third section. Students evaluated statements on a five-point Likert 
scale, where 1 stands for “strongly disagree’, while 5 stands for “strongly agree”. The research plan was 
adopted from the previous study of the impact of social networks on the recruitment of college students 
conducted by Vukic and Vukic (2019), but this study provides more detailed insight into the significance of 
social networks for creating positive image of HEI. 

Quantitative research methods were applied and data analysis was done using IBM SPSS 25.0 
for Windows software. Descriptive statistics was used for computing mean and standard deviation of all 
items. Mann-Whitney U Test was used, in order to test the equality of Mean Rank in two independent 
samples. Spearman’s Rho was used in order to measure the strength of correlation between two 
variables that did not have a normal distribution. Kruskal-Wallis H Test was applied. In order to obtain 
Statistically significant evidence, that there is a difference in Mean Rank between more than two groups 
of independent variables. Chrombach Alpha reliability test was used to check the internal consistency of 
the statements used for measuring summed scale of perception. These non-parametric analyses were 
conducted, because Shapiro-Wilk’s test (p < 0.01) showed that criteria for normally distributed data were 
not met. The results of the study should answer questions such as: 1) What are students’ experience 
and attitudes toward faculty social media strategy; 2) What is students’ perception about the image of 
the faculty on social networks; 3) Is there a correlation between the faculty image on social networks and 
attraction of new students; 4) Are there statistical differences in students’ perception about the image of 
the faculty across their different characteristics e.g. sex, year of the study, content which they pay the 
most attention to when they visit a faculty's profile. 
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Results and Discussion 


A total of 270 students completed the questionnaire. Demographic data show that the number of 
female respondents was slightly higher than the number of male respondents. The average age of the 
respondents was 22.18 (SD = 2.27) while average grade during studies of the students from the sample 
was 8.17 (SD = 0.62). More detailed information about demographics of the sample is shown in Table 1. 


Table 1 
Sample characteristics 
Frequency Percent 
Sex 
male 132 48.9% 
female 138 01.1% 
Total 270) 100% 
Year of study Frequency Percent 
first 30 11.1% 
second 4s 16.3% 
third 66 24 4% 
forth 62 23.0% 
only exams left 32 11.9% 
graduated 36 13.3% 
Total 270) 100% 
Minimum Maximum Mean std. Deviation 
Average grade f 10 6.17 0.62 
Average age 18 31 22.18 221 


Regarding the way of obtaining information when enrolling in faculty, the students mostly made use 
of word-of-mouth propaganda (41.1%), followed by personal visits to the faculty (24.1%), the third source 
of information being their high-school teachers (13.7%), the fourth social networks (12.6%), whereas they 
were least informed through the visits of the faculty representatives (5.2%) or propaganda in the media 
(TV, radio, magazines, newspapers). Insufficient use of social networks for obtaining information could 
indicates that faculties’ social media profiles don’t give enough real time information about enrolment. 
Prospective students are easily bored searchers, that’s why faculties will need to transition from traditional 
communication to content that is visually appealing and psychologically intrigues. Sharing stories could 
make stronger connections with the faculty, and help students in decision making process. Live features 
could engage current and potential customers by sharing faculty events in real-time, which can bring them 
a real sense of what student's life is like from a student's point of view. Good social media strategy gives 
new opportunities for faculties and even brought personality back into a digital world. However, all this, 
open research gap for additional examination of such a poor rating of social network. 

The respondents think that the most important social network in terms of attracting new students is 
Facebook (mean = 3.84), followed by Instagram (mean= 3.64), whereas the less important are LinkedIn 
(mean = 2.31) and Twitter (mean = 2.16). Such a small significance of LinkedIn and Twitter may be an 
indicator of the infrequent use of these social networks, which should be further investigated. 

The results have shown that a vast majority of students follow their faculties on social networks 
(81.1%) whereas only 18.9 % do not. This finding leaves plenty of opportunities for faculties in Serbia 
to exploit the potential of social networks and apply a new branding concept, which will positively affect 
their reputation and consequently make it easier for the students to differentiate between competitors. 
However, the faculties follow a very small number of students (24.1%); that way, the faculties are missing 
the information on the contents students post and the ones they react to, thus losing the most important 
purpose of social networks — interactivity. 

students check the faculties’ social network profiles mostly in order to get informed (96.3%), very 
few of them for educational purposes (0.7%) and for fun 3%. Such information may indicate that other 
contents are posted to a lesser extent, and therefore it is important to check their preferences towards 
the contents they would like to see. However, in order for the faculties to have diverse content on social 
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networks, the faculty itself has to reshape its own business model in terms of offering new educational 
package that will be developed together with the students and stakeholders, creating new values. 

The source of information most trusted by the students when it comes to notification during their 
Studies is the official website (80.4%), as expected; their professors come in second (8.1%), fellow 
students third (7%), faculty profile on social networks fourth (2.6%), whereas other sources come in last 
(1.9%). This may indicate the fact that the notifications on social networks are not regularly updated, or 
that they are considerably late in doing so compared to the website, so it is safe to say that the faculty do 
not have a clear social media strategy. 

As for the students’ perception related to the contents on the social networks of the faculty, most of 
them pay the most attention to the text (68.1%), half as many to the picture (30.7%), and the least of them 
pay attention to the video (1.1%). 


Students’ perception of faculty image on social networks 


Except from the students’ experience and attitudes towards the faculties’ social media strategy, 
this study investigated students’ perception of faculty image on social networks. For this purpose, a new 
summary scale was designed, consisting of individual items of students’ attitudes towards the image on 
social media. The theoretical range of the scale ranges from 1 (denoting the perception that the faculty 
image on social networks is not satisfactorily) to 5 (image of the faculty on social networks is highly 
satisfactory), whereas the empirical ranges from 1.11 to 5 (Table 2). The average value of the students’ 
responses on the summary scale is 3.12 (SD=0.82), showing that the students consider the image of the 
faculty on social networks not indeed satisfactory. The distribution of the students’ responses in Table 
3 statistically significantly deviates from normal (p < 0.01); therefore, for the analysis of the students’ 
perception of faculty image on social media, non-parametrical tests shall be applied (Spearman's rank 
correlation coefficient, Mann-Whitney and Kruskal-Wallis test). The new summary scale of faculty image 
on social networks indicates a satisfactory level of reliability (Cronbach’s Alpha> 0.7), which can be seen 
in Table 2. All further analysis is conducted with summarized scale. 


Table 2 
Reliability of summary scale of faculty image on social networks 


Minimum of Maximum of Empiric Empiric Mean Std. Cronbach's BIg - 
scale scale Minimum Maximum Deviation Alpha ohapiro-Wilk 
Faculty 
| 5 1.11 a 3.12 0.82 0.64 0.03 
Image 


The summary scale of the image consisted of the responses expressed through the level of 
agreement with the nine statements, such as: 1. quality of enrolment information on faculty social media 
profile is very high; 2. image of faculty on social networks can have positive impact on my employment: 
3. social media profile of my faculty is interesting; 4. faculty social network profile offers high quality 
information about current information necessary for students; 5. social network accounts give enough 
information about internship opportunities; 6. social network accounts offer educational content; 7. 
social network accounts give detailed information about the enrolment of new candidates; 8. professors 
should use more social network for communication with students; 9. social networks have advantages in 
communication with students in comparison to traditional ways of communication. 

It can be seen in Table 3 that the students expressed the highest degree of agreement with the 
statement that the profile of their faculty on social networks provides detailed information on the enrolment 
of new candidates; on the other hand, they least agreed with the statement that the communication with 
students through social networks should have an advantage over traditional means of communication. 
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Students’ attitudes towards the faculty image on social networks 
statement means St. dev Min Max 
1 oof 1.183 i + 
2 3.26 1.216 i + 
3 291 1.129 i 3 
4 3.43 1a i 3 
a 2.94 1.245 i 5 
6 3.06 1.134 / $1 
f 3.53 1.263 / #1 
rs) 3.00 1.462 / + 
g 2.54 1.415 i +) 


Spearman's rank correlation coefficient (Table 4) showed a statistically significant positive 
correlation between the faculty image on social networks and attracting new students through them. 
The more positive the image on social networks, the greater the number of students who are interested 
in enrolling in faculty. The positive image of the faculty on Facebook (0.44, p<0.01) is mostly related to 
attracting students, somewhat less is related with Instagram (0.33, p<0.01) and Twitter (0.26, p<0.01), 
and much less with LinkedIn (0.12, p=0.05). 


Table 4 
The correlation between the faculty's image, students’ age, positive impact of social networks on 
re-cruiting new students and perception of the importance of a different social network 


Facebook Instagram Linkedin Twitter 
Correlation Co- 
_ 0.44" 0.33" 0.12° 0.26" 
Faculty image efficient 
Sig. (2-tailed) 0.00 0.00 0.05 0.00 
Correlation Co- 
- 0.02 0.02 0.32" 0.05 
efficient 
Spearman's rho Age 
Sig. (2-tailed) O77 0.81 0.00 0.41 
Promotion on social Correlation Co- 
7 : 0.49" 0.31" 0.26" 0.23" 
networks have positive efficient 
impact on recruiting 
Sig. (2-failed) 0.00 0.00 0.00 0.00 


new students 
™ Correlation is significant at the 0.01 level (2-tailed). 


* Correlation is significant at the 0.05 level (2-tailed). 


Positive correlation was also found between age and perception of attracting new students via 
LinkedIn (0.32, p <0.05), i.e., older students consider LinkedIn important for attracting new students, 
which may indicate that these are mostly respondents who are employed, which is why they consider 
this network attractive. The perception of the importance of other networks for student enrolment was 
not related to the age of the respondents (p> 0.01). There is a statistically significant connection between 
promotional activities on social networks and the attracting of new students. Namely, more intensive 
Campaigns on Facebook (0.49, p <0.01) and Instagram (0.31, p <0.01) are associated with greater interest 
in enrolment, while higher promotional activities on LinkedIn (0.26, p <0.01) and Twitter (0.23, p <0.01) 
affect students but to a lesser extent. 

Statistically significant correlation was not obtained between the faculty image and the age of 
respondents (0.03, p>0.05) and between image and the average grade (-0.04, p>0.05). The Average 
grade does not show a statistically significant correlation with the attitude that promotion on social networks 
positively impact recruiting students (0.01, p>0.05), or with the perception of the significance different 
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social networks (Facebook, Instagram, LinkedIn and Twitter) for recruiting new students (p>0.05). 

Mann-Whitney U Test results confirmed statistically significant differences in the level of faculty 
image perception on social networks between the students who follow the faculty accounts and those who 
do not (3882.000, p<0.01), and between students who are followed by the faculty accounts and those who 
are not (5281.000, p<0.01) as shown in Table 5. Students who followed their faculty on social networks 
and those who are followed back, perceived faculty image more positively than the other one. 

Mann-Whitney U Test indicates no significant difference in the level of expression of a positive image 
of the faculty on social networks, between the male and female students (9092.500, p>0.05). Results of 
Kruskal Wallis Test (8.400, p>0.05) suggest no significant difference in perceived image between students 
of different year of study (8.400, p>0.05) and depends on the content they pay the most attention to, 
when they visit a social network profile (picture, text, video) (0.765, p>0.05). Also, same test suggests no 
significant difference in perceived image depends on purpose of checking the profile of the faculty (3.836, 
p>0.05); the way they obtained information on the faculty they enrolled in (3.297, p>0.05) and the most 
trusted source they used to obtain information on the faculty (4,635, p>0.05). 


Table 5 
Students’ faculty image perception depending on whether they are following faculty account, and 
whether they are followed back on social networks 


Question Mean rank Mann-Whitney U f Asymp. Sig. (2-talled) 
Do you follow faculty on social networks 
Yes 143.27 3882.000 -3.394 739 0.00 
No 102.12 
Are you followed back by faculty on social 
networks 
Yes 156.45 5281.000 -2. 522 0.01 
No 128./6 
Conclusions 


The study aimed to investigate how students perceive the image of their faculty on social networks, 
but also to analyse their experience and attitudes towards faculty's social media strategy. Trough empirical 
research we gathered information which can contribute HEI in creating adequate communication strategy 
with prospective and current students. Also, based on results it is possible to make interactive brand, 
which will facilitate a students’ journey towards pursuing a graduate degree. Creating content based on 
the students’ needs it is possible to turn social networks into search engines which will answer all the 
necessary questions, from looking for financial costs and career opportunities, to faculty projects. 

Much research has been done on usage of social networks in HEI, but most of these studies have 
addressed the topics such as learning and teaching possibilities, impact of HEI brand image on students’ 
satisfaction, and decision-making process (Duque, 2014; Kuzma and Wright, 2013; Kumar and Nanda, 
2020; Pucciarelli and Kaplan, 2016). Despite large scope of papers, there is lack of knowledge about how 
HEl’s image on social media affects students’ interest for enrolment. 

The results of this study have shown that students primarily pay attention to the text, when It comes 
to HEI social network profiles. Such results can be considered logical, as the primary purpose of faculty 
social network profile is informative communication. However, in order to create a recognizable image, it 
is also important to make use of transformative communication implying the values offered to students, 
and therefore the institutions of higher education must carefully design various contents, as the stimuli 
such as text in an advertising message require more attention to be understood than a picture or a video. 
Due to the rapid adaptation to one type of stimuli, in order to attract the attention of current as well as 
potential students and other stakeholders, it is necessary to use other means of gaining attention such as 
colours, sounds, videos or various types of novelties, so that it could be managed. That way, it is possible 
to create an advertising message that contains essential information but at the same time manages to get 
students spend more time on social network profile of the faculty, in order to convey to them clearly the 
values they are offered. 

When it comes to the enrolment information, research result showed that sources of the greatest 
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credibility are friends, acquaintances, forums, i.¢., all those who are not paid to promote the college. Visits 
to the faculty instil great confidence during enrolment, due to the expertise I.e., professional knowledge 
of the professors or members of staff with whom students communicate. Social networks and media are 
the least likable sources in these situations, and therefore the focus should be on the development of 
ideas and creative strategies of communication that will help a better positioning of the faculty relative to 
competitors in virtual space. 

Exploring the perception of the faculty's image on social networks, findings showed that the 
respondents think that Facebook and Instagram have the greatest influence on a positive image. This Is in 
line with the findings of Slover-Linett and Stoner (2011) as well as Peruta and Shields (2018). Therefore, 
the promotional activities should be directed towards these networks. It was discovered that the perception 
of the faculties on social networks does not depend on the gender, year of study, the content students 
visited on social media profile or the way of obtaining information about enrolment. 

The positive image is rather related to whether the students follow the faculty's social media profiles 
and whether they are followed back. This can only indicate that the students place great value on social 
networks I.¢., that the social networks are important to them, which should be further examined. 

This paper makes a number of contributions, but the most significant ones are: 

¢ Research about students perception and attitudes toward HEI image on social networks is 
extended and the body of knowledge how digital faculty brand image can attract prospective students Is 
enriched. 

¢ Students’ perception and attitudes toward faculty social media profile were identified. 

¢ Anew social media strategy is proposed according obtained results. 

This study has certain limitation. First limitation is that sample doesn’t include private faculties 
which social media strategy could be quite different from our sample. The second limitation is the reliance 
on respondents who studied hotel management and tourism courses when making conclusion about 
the image of faculty on social networks. Also, students of higher vocational schools are not surveyed, 
SO we can't compare their image perception with academic one. And the last one, is the fact that survey 
is conducted in Republic of Serbia, so the results could be specific to this territory only. Future research 
could focus on the collection of more diversification of respondents by their fields of education, countries 
and ownership structure. 
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Abstract: Since the beginning of XXI century higher education internationalization trend has been intensifying around 
the world. The goal of the research is to study managing international education characteristics to promote educational services 
export. Levels of interconnection and interdependence between economic agents around the world are increasing; transnational 
forms of economic activity, information and communication technologies are developing. The market for higher education is 
developing intensively as educational services of the highest international level demand is increasing. The research goal is to 
analyze the main economic tendencies in modern students’ exchange programmes. The problems discussed are the need to 
increase educational services export by promoting it using various student exchange models, study of managing international 
education characteristics to promote educational services export and its development. For this purpose the methodology 
consisting of modeling educational policy processes and analyzing the results is used. The results of the study show that higher 
education takes on international socio-economic features, which are to be seen as an attractive investment target. Modern higher 
education is developing in the conditions of open access and mutual influence of conditions in different countries, depending 
on the basis of economic, political and cultural relations. The growing interest in education abroad leads to existing paradigm of 
educational services management review thus updating this study's topic. In the conclusion we highlight that integrative processes 
in internationalization of education management can significantly enrich practical application in this sohere. Recommendations 
in this study can be used to increase educational services export and import. 

Keywords: student exchange, education management, education export, international education, academic mobility. 


Introduction 


Many scholars note that “information, knowledge and innovations, as well as ways of their practical 
application, are increasingly considered as a source of profit in a post-industrial society” (Ussenova et 
al., 2020). In this situation, education has taken a leading place in the world economic development, 
increasing labour productivity, human capital quality, and the long-term results of the social production 
efficiency growth. According to British scholars Bridges and Bridges (2017); Menzies and Baron (2014), 
“transnational education refers to all types of higher education programs, complexes of educational courses 
or educational services, dual enrolment opportunities, summer bridge programs and team projects”. Such 
programmes can be provided by a country’s educational system or may be independent of any systems 
at all. International students’ exchange may be studied theoretically and applied practically. According to 
different researches’ meta-analysis, the main problems of students’ exchange are the institutionalization 
of international education and management of students’ needs, psychological and social support shapes 
and structure, and the transition from the national to international. Thus, “research focuses on the methods 
of internationalization at the individual, institutional, and national levels” (Bedenlier et al. 2018, p.108). 

SO far, international education has significantly changed its direction. The term “education export’ 
has appeared. The programs of double and multiple diplomas, the International affiliations of the world’s 
leading educational institutions, franchised universities and joint programmes of international education 
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have been developed. There is an urgent need in standard procedures, educational quality criteria, 
regulatory policies and tendencies monitoring development. “The international protocol for worldwide 
collection of transnational education data is developing, similar to what United Nations Educational 
scientific and Cultural Organization (UNESCO) and Organization for Economic Co-Operation and 
Development (OECD) do for international student mobility” (Knight, 2016, p.34). 

Researchers argue that political factors are overestimated, but the need for systematic long- 
term planning is underestimated. Anyway, the internationalization of education and academic mobility 
programs are neither uniform nor linear. They are aimed at long-term processes, the results of which are 
uncertain, since they are difficult to predict in the context of rapid social, political and economical change 
(Dakowska, 2017, p.588). Specific tasks include joint educational programs and double-degree programs 
facilitating the new programs development, knowledge and experience sharing; individual teachers’ 
mobility programs, visiting professors’ lectures delivering etc. International students’ and teachers’ 
mobility consists of “training, data collection for research, internships, job shadowing, a staff training 
week attending, joint projects implementation” (Makarova, Makarova and Hijaltadottir, 2019). Thus, 
experience shows that international exchange programs and students’ support are effective when they 
are established on the foundation of the development of the national education system priority areas. For 
example, the International Baccalaureate program existing in a number of world universities is focused 
on intra-personal, inter-personal qualities and pro-social development. It pays attention to the holistic 
development of personal traits, including pro-social behaviour shaping (Bailey and Cooker, 2018 p.228). 

Staff mobility plays a significant role in international education development. The involvement 
of foreign professors and researchers into university activities is “one of the competition areas in the 
international market of educational goods and services” (Ismailova et al., 2020). The world’s leading 
universities usually have an international team of scientists and professors; foreign teaching staff 
percentage in the educational process is one of the most impressive indicators in the world’s leading 
universities rankings. The world leader in international education development is the United States 
of America. According to statistics, foreign professors make up 33% of the total faculty at the US 
universities, while in Russian universities the share of foreign instructors ranges from 0 to 5%, most 
of them in leading institutes or federal universities in Moscow. Foreign professors Invitation targets 
achieving several academic and non-academic goals, the major one being the university's competitive 
qualities development and the ranking in the world system. Mentioning other goals, we call the range of 
educational programs expansion, which means integrated and joint training programs inclusion, English 
language education programs implementation, compliance with international educational standards and 
demands, new research areas development demanded by the global scientific community, develooment 
of the university's positive image, and improvement of its recognition in the world. 

An important tendency in the world education development is the introduction of digital and 
network technologies into education and transition to online learning, having two sides. First of all, digital 
technologies, gamification, edutainment are substituting traditional classroom learning. “New information 
technologies are becoming an important aspect of the international educational context as much as the 
content of education and the people who participate in it” (Mcvicar, 2015). 

Another educational trend is educational organizations integration. This includes various participants 
in educational goods and services market, involving potential employers, national and international 
services providers, even those companies that have never dealt with educational goods and services 
before. Another effective tool in the world market of educational goods and services competition has 
been the growth of mergers of academic institutions or integration of individual institutions as faculties of 
universities or academies. The universities in Finland, for example, are heading most consistently in this 
direction; as a result of the merger, new educational institutions are being formed to become leaders in 
national education. Similar processes take place in Denmark: 8 universities and 3 research centres were 
established out of 25 universities and research centres. The expansion of universities in Europe and the 
USA during the last 20-30 years is a global tendency. Among the objectives of this tendency, experts 
usually highlight the universities intention to improve not only their performance in the national market of 
educational goods and services, but also their international rankings. 

As noted by Knight J. (2018), “there are three different principles underlying the formation of 
educational hubs as a new form of international educational centres - the student hub, the talent hub, and 
the knowledge and innovation hub”. Such integrated units can be built upon three different foundations. 
They can be focused on students engaged in the recruitment of foreign citizens eager to get education 
in RF. In addition to student recruitment, such centres are developing new promising joint or franchising 
programs, double and multiple diplomas programs, targeting not only foreign, but also local students. 

Another type of educational integrators is the centre of talent; their main task is human resources 
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development. The main goals of such integrators are expressed in attracting talented youth and skilled 
workers from abroad. Educational integrators of the third type are Knowledge and Innovation Hubs; their 
main activity is scientific research for the production and dissemination of new knowledge and introduction 
of innovations. The goals of such integrators are the creation of favourable conditions for research 
activities, foreign investments attraction, competitiveness of applied scientific research development and 
increase (Buckner, 2017 p. 296). 

According to Organization of Economic Cooperation and Development, “the number of students 
getting education outside their own country) increased threefold from 1990 (1.3 million people) to 2011 
(4.3 million people)”. According to the UNESCO forecast,” the number of students learning outside their 
native ciuntry will reach 7.2 million by 2025” (Amirov, 2018). This perspective is associated with the state 
education regulation intensification in many countries. “Annually different international higher education 
scholarship programs attract a significant amount of funds from national governments, supranational 
organizations, large charities, higher education institutions and many other smaller organizations. 
Internationally targeted scholarships fund students in higher education institutions around the world” 
(Mawer, 2017). The US government identifies promising in the area of education target countries, recruits 
educational institutions that are interested in expanding their international involvement and foreign students’ 
enrolment, and promotes these programs to students, teachers, and educators in the target market also 
providing assistance in receiving certain types of scholarship and grants. Education ranks fourth in terms 
of exports, second only to exports of dairy products, tourism and meat. In addition, international education 
makes a significant contribution to the labour market and supports world’s economy. 

In Russia Global Education state program was recognized and successfully implemented in many 
State educational institutions in 2013. Russian education export system has a great developmental 
potential, as many foreign experts have noted; budgetary revenue from educational services export will 
grow from 78 billion rubles in 2017 to 198 billion rubles in 2025. Financing is through contributions of the 
RF budget and private donations from sponsors’ to a special educational fund. The program participant's 
fees for tuition; accommodation; transportation costs and educational resources are paid through the 
fund in advance, while medical insurance and personal expenses are reimbursed. The largest number of 
universities approved by this Program is in the countries whose universities are leaders in higher education 
(the US, Great Britain, Germany, and Canada). Improvement of Russian education competitiveness in 
the international market of educational goods and services is associated with the internationalization 
strategies for education system levels development and improvement. 


Materials and Methods 


International Education Management: Models and Educational Policy Processes 

Management of higher education, including international, has its own peculiarities, associated with 
the special status of higher education institutions. On the one hand, universities are educational, scientific 
and cultural centers that meet the requirements of society and the state in preparing professionals needed 
by the economy and in increasing new knowledge and innovations. This is the social significance of 
universities. On the other hand, universities are included in the market of educational goods and services 
as entities producing and selling services. This is the economic importance of universities as full-fledged 
subjects of market economy (Pashakhina, 2020 p.110). 

According to Etzkowitz H. (2016), universities acquire entrepreneurial traits, transforming knowledge 
into economic activity, playing a creative role in the economic and social development of education both at 
the state level of one country and in the international education market. There is a clear idea that despite 
the participation and various external factors influence, the three main actors in the educational policy are 
the state, an educational organization and business (Cai and Etzkowitz, 2020). 

Speaking about the adaptability of each model to a rapidly developing market, we should note 
that the one with the greatest variety of educational activity agents, sources of financing, a high level of 
educational organizations autonomy and academic mobility will be most adaptable. With regard to the 
management of international education in Russia, it is necessary to distinguish three levels of the agents: 
federal, regional and university (Bondarenko et al., 2018, p.6). 

At the level of federal government and departments, state policy target guidelines in the field of 
international education and educational services export are set; priority federal projects in the education 
field and the main directions implementation are developed. The objectives of the state educational policy 
are to expand the export of educational goods and services as a form of non-resource export, the inflow 
of labour capital, attracting talented foreign students, Russian education brand promotion abroad, and 
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Russian language and culture popularization among foreign citizens. 

The following frameworks are being developed at the federal level: framework governing foreign 
students’ entry into the country; a system of quotas for foreign students; bilateral agreements between 
States. 

International education management at this level has a number of features: 

¢ territorial support programs for academic mobility are developed and implemented, 

¢ information centers are created to support, adapt and interact foreign students with the local 
community, 

¢ procedures are developed to solve the problem of foreign citizens studying in the region 
employment. 

These activities entrepreneurial nature allows for a new way of presenting and flesh out the main 
functions of the educational organization of higher education in international activity. The university's 
traditional business functions are teaching and training; researching, marketing, financial and economic 
activities. 

According to researchers (Gaus and Raith, 2016), education, research and entrepreneurial 
functions are included in the university's business process system. The international activity of educational 
Organizations allows for the use of the above mentioned business processes. Management of these 
university business processes Is carried out in the following areas: financing sources that provide funding; 
distribution channels through which it is transmitted; customer segments as the main target purchasers of 
goods; sources of revenue generation; costs implementation directions (Silakova, 2017). 

Entrepreneurial business process is expressed in the diversification of educational services, 
educational programs of various durations, target audience, level of education, and technologies applied 
in teaching and training. An important part of the entrepreneurial process is the expansion of consulting 
services range for the state, business and citizens and these services launch into international market. 

Summing up the results of theoretical analysis, a number of basic principles are formulated. Modern 
international education develops very intensively. The main trends are related to integrative processes 
in higher education, increasing academic mobility level, strengthening state regulation role, digital and 
network technologies, as well as individualization of educational trajectories for talented students. 

Analysis of the Global Market for International Education. The global market of educational goods 
and services is developing rapidly involving all countries of the world. Researchers say that international 
education market development has both economic and social significance. Education as a type of service 
is a special line of business, and today the leading players in this market receive substantial income 
from training foreign students. In educational economy, knowledge is the main factor in goods and 
services production. Economy based on knowledge has succeeded in creating prosperity and wealth 
with participation of gifted and talented people, high intelligence, professional skills, and a wide range of 
diverse demands from society and the Government. 

According to OECD estimates, around 140 million students in the world are studying in 36 thousand 
higher education institutions. Most of them get education in their own country. However, the number of 
students studying abroad is growing rapidly. According to UNESCO, the number of international students 
in the world is growing steadily; in 2017 it amounted to more than 5.341 million people. As shown in Figure 
1, in 2000 this indicator was at the level of 2.1 million, in 2003 it was 2.65 million, in 2007 it overcame the 
mark of 3 million, in 2013 it exceeded 4 million, and in 2016 it reached 5 million people. 





Figure 1. The number of international students in 1998-2017, million people 
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The main segment of the international educational services market is higher education programs. 
The share of countries participating in the educational market of goods and services is heterogeneous. 
Today, this market prevailed mainly in three countries in different parts of the world: the USA, Great Britain 
and Australia, all of them are English-speaking. 

Figure 2 shows the latest OECD (2019) data on the market for international educational services, 
the share of foreign students studying in each country of destination, in terms of all mobile students in 
the OECD and partner countries. As shown at Figure 2, the leading positions are occupied by the United 
States, teaching 22% of all international students of the world, the UK is second with a share of 10%, 
Australia is third (9%), having recently significantly strengthened its position in the educational market. 
Fourth, fifth and sixth places are divided among three countries of Europe - the Russian Federation, 
France and Germany (6% each). 





Figure 2. International students enrolled in each destination country as a share of all mobile students 
in OECD and partner countries (2017), % 


Thus, students mostly study in Europe, where they are distributed across several countries (France, 
Germany, the Russian Federation, Austria, Italy, the Netherlands, Turkey and others). Although North 
America takes fewer students in absolute terms, the United States holds firm leadership positions not only 
on the continent, but also in the world. A large number of foreign students in English-speaking countries 
indicate a high level of interest in English-language education. Table 1 shows the dynamics and changes 
in the percentage of foreign students studying in a particular country. 


Table 1 
Percentage of foreign students in the given country (2010, 2013, 2017) 


Percentage of foreign students 


Country 
2010 2013 2017 
Australia 22,08 Viel 21,48 
United Kingdom 16,04 1/46 1 ies 
Canada no data 9 f2 12,92 
France no data 9/8 10,20 
Germany 199 Ati O3f 
United States 3,54 38f 9,18 
Japan no data 343 4?f 
Russian Federation 2,02 1,64 4 (8 


Source: OECD/UlS/Eurostat (2019). 


As can be seen from the data, Australia holds the leading position in this issue, where the share of 
foreigners Is the highest - from 17% to 22%. Alarge percentage of foreign students is traditionally seen in 
the UK (16-17%, and the percentage is growing). Positive dynamics Is in Canada (9-12%), the USA (3-5%) 
and the Russian Federation (1-4%). However, among the leading countries in the international market of 
educational goods and services demonstrated in Table 1, Russia occupies the lowest position; it is in the 
eighth line. Comparing other data, we can say that postgraduate education of foreign students is one of 
the most important areas in the global educational services market. High percentages for master’s and 
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doctoral programs are noted in all countries - leaders of the international education market. According to 
doctoral programs, the first place belongs to the UK (42.1%), according to master’s programs - to Australia 
(47.7%). An interesting trend is found in Australia - a rather high percentage of short-term students (20.2%). 
In Canada, this share is 12.7%, and for the rest of the market participants this segment of educational 
services Is poorly represented or not represented at all, as in Germany, for example. Meanwhile, short- 
term educational programs are becoming increasingly relevant in the context of individual educational 
trajectories and the concept of life-long education. Development of short-term programs (for example, for 
improving language competencies in a native language environment) can become a significant advantage 
for the country in the international educational services market. 

All countries of the world that are the major players in the educational market and in the export of 
educational goods and services can be divided into two main groups - hard and soft sellers. The hard 
sellers in the market of educational goods and services are Denmark and the UK in Europe, Argentina 
and Brazil in South America, Canada and the USA in North America, India, Australia, and New Zealand 
in other parts of the world. In these countries the universities occupy the highest positions in the world 
rating that is why the tuition fee is usually threefold compared to other universities of the same rank in 
other countries. For soft sellers, the tuition fee for foreign students is compensated by payments from the 
budget sources. For example, in Germany, France, Finland, Sweden, foreign students do not pay for their 
study in state universities, but have to pay if they enter some private educational institution. Thus for such 
a country that provides educational goods and services, the profit from educating foreign students is not in 
a tuition fee, but in money paid for accommodation, food, travelling, entertainment, books, stationary etc. 
In addition, such countries get profit when they attract educated emigrants to their labour markets who will 
stay in the country after graduation and start working in different areas of economics. 

Tuition fee is also a sophisticated financial mechanism that can regulate the domestic market 
of educational goods and services. For example, in Great Britain EU countries students’ expenses are 
completely different from those of other countries’ students (depending on the status of the university), but 
these expenses are lower for British citizens anyway. In this way, the university gets enough money for its 
existence and prosperity without raising prices for national students training. 

With such a sophisticated market strategy, the university can meet the requirements of the national 
industry development and innovative technologies introduced; the need in skilled staff; demographic 
changes; standardized legal space, national government attitude to education in general, education 
development and advance in compliance with the progress, etc. Without taking all these factors into 
account, expanding the borders of the market and increasing profits are not possible; exports in general 
are not conceivable. 

There are many TNCs: DAAD (Germany), British Council (Great Britain), CIMO (Finland), IDP 
Education Australia (Australia), EduFrance (France) and others. Some of them are engaged exclusively in 
education, and some are in related areas - culture and art. The daily practice of TNCs includes hundreds 
of projects: they support development and distribution of national language programs, arrange student 
and staff mobility, provide support in information dissemination and advisory services, etc. The TNC 
format has proved to be extremely productive both for students and staff. 

A significant part in students’ mobility setup is played by international unions and organizations 
with academic focus. NAFSA (Association of International Educators) is the world’s largest non-profit 
association dedicated to international education and academic exchange. NAFSA‘s 10,000 members 
are located at more than 3,500 institutions worldwide, in over 150 countries. European Association for 
International Education (EAIE) is the European centre where experts work creating networks and resources 
and providing higher education globalization. EAIE is a non-profit, non-governmental organization helping 
people worldwide to get education in a foreign country through a combination of academic training, 
scientific conferences and forums, knowledge dissemination and sharing. EAIE assists academic and 
non-academic professionals in their challenge to get through; by providing opportunities of international 
exchange. EAIE partners promote membership interests and advance international higher education in 
Europe and in the rest of the world. These organizations show that the international market for educational 
goods and services can be structured from different points of view, not from the point of financial profit, 
but of academic and scientific benefit for the whole mankind. This market includes enrolment of students, 
establishment of campuses and branches abroad, as well as distance learning. 

Features of Educational Services Export Management in Russia. The first lines in the ranking of the 
best world universities are consistently occupied by the universities in the USA and the UK. Traditionally, 
the group of countries with a developed education system also includes Switzerland, Australia, Canada 
and China. According to QS World University Rankings 2020, Moscow State University remains the best 
Russian university in the QS ranking - 84" place, rising six positions compared to last year. The second 
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place among Russian universities was occupied by Novosibirsk State University (231* position), the third - 
St. Petersburg State University (234" position). In total, 25 Russian universities entered the top 1000, with 
15 of them improving their positions constantly. Massachusetts Institute of Technology (MIT) has been 
recognized as the best in the world for the eighth consecutive time. 

In 2017 the RF Government adopted an academic document “Export potential of the Russian 
educational system development” containing predictions of results and methods for achieving goals in the 
field of expanding the education export potential of the RF by 2025. The key goal of this academic project 
is to significantly increase Russian education's competitiveness in the international market of educational 
goods and services and thereby to enhance non-resource exports of Russia. For this programme 
implementation it is necessary to design and develop the university's versatile strategy in the education 
export, it is also necessary to mold certain services to support foreign students. By implementing this 
project the RF Government is planning to attract full-time students from foreign countries up to the number 
of 510 thousand people, and the extra-budgetary funds received from the Russian education export will 
go up to 303,147 million Russian rubles. 

The Russian statistical collections (Federal State Statistic Service) prove that every year the 
number of foreign students in higher education programs Is increasing. Comparing predictions with the 
real numbers, we can see that over the period of 5 years, the total number of foreign students has grown 
by 64,442 people, full-time students by 41,296 people. The number of foreign students enrolled in RF 
universities is steadily growing, and the number of foreign universities participating in the priority project 
is growing (Figure 3). At the moment there are 39 of them, but according to the project, by 2021, all the 
Russian universities should use the “Model for education export.” 
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Figure 3. Foreign students enrolled in Russian universities (2007-2018), people 
Source: Russia in numbers. 2007-2019. Rosstat 


The percentage of foreign students enrolled in RF universities at all the levels is growing steadily. 
Fig. 4 shows the ratio of foreign students to the total number of students (percentage). As can be seen 
from the data presented, in 2017 this share was 7.1% and over the past few years has grown several 
times. 
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Figure 4. The ratio of foreign students to the total number of students in RF universities (2000 — 
2017), % 


Source: Russia in numbers. 2000-2018. Rosstat 
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According to statistics, about 80% of all foreign students study at the undergraduate level; this 
percentage has grown steadily over the course of several years (from 63.48% in the 2006-2007 academic 
year to 80% in the 2017-2018 academic year). The share of students in the Master's program ranges 
from 14.15% in 2014-2015 to 23.36% in 2009-2010, while there is a tendency for reduction. In 2017- 
2018 academic year, the share of students in the Master’s program is about 15%. As for post-graduate 
education, an even more significant decrease is observed in this sector of education - from almost 15% in 
2006-2009 to 4.85% in the 2017-2918 academic years. It can be concluded that foreign students are more 
interested in obtaining a bachelor’s degree in higher education institutions of the Russian Federation than 
in Master's or Doctorate programs. 

The success of educational services export depends to a great extent on the number of students 
getting education on a commercial basis and on the cost of training. Fig. 5 presents the dynamics in the 
increase of foreign students enrolled in higher education institutions on a commercial basis in 2014-2018. 
As shown, this indicator decreases annually, with the largest drop in 2015. Further, the decline slowed 
down, but the number of the countries exporting students continues to decline. 
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Figure 5. The number of foreign citizens studying in higher education organizations on a contract 
basis for 2014-2018, people 


Source: Russia in numbers. 2014-2019. Rosstat 





In 2018, according to the statistical digests, the number of foreign students was grouped into those 
who studied in state or community universities, and those who studied in private educational institutions. 
In 2015-2016 there was a slight decrease in the number of foreign students enrolled in private educational 
institutions. Income from the export of educational goods and services is presented in Figure 6. The 
revenues of state and municipal universities from the export of educational goods and services are 
expectedly higher than those of private ones, but there is a noticeable upward tendency in both groups. 
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Figure 6. Total tuition fees for foreign and international students in public and private educational 
institutions of the Russian Federation, million rubles 
Source: Russia in numbers. 2015-2019. Rosstat 


All the foreign students enrolled in RF universities are unevenly distributed across the regions of 
the country. Russia is not a very successful player in the export market of educational goods and services, 
but strengthening its position from day to day. This is facilitated by the implementation of state priority 
projects and models for managing international education. 
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Models for Managing International Education and Promoting Educational Services Abroad. 
Currently, each country as a serious player in the market of educational goods and services is making 
special efforts to internationalize educational services. This is done both at the state level and with 
publicprivate partnership, as well as mutually beneficial triangular relations between the state, business 
and education. Hawawini G. (2016) describes five models of internationalization of education: Export 
Model, Import Model, Academic Joint Venture Model, Partnership, Alliance & Consortia Model, Foreign 
Campus Model. 

Export Model is implemented for educational services distribution abroad, attracting foreign and 
international students to study in full-time programs. Upon educational program successful completion, 
foreign students receive a degree, diploma or certificate. Such students pay for their studies either on 
their own, or with grants and scholarship support by non-governmental and non-profit organizations and 
endowment funds (Makarova, Makarova and Korsakova, 2019). There is an indirect option for foreign 
students, when they study without paying tuition fee, but at the expense of the host state. However, they 
pay for accommodation, meals and other household and cultural needs. The economic effect is the sum 
of all foreign students’ expenses during their stay on the territory of a host state. 

Import Model suggests foreign instructors’ involvement. Knowledge and experience that foreign 
experts possess Is imported, and an educational institution profit depends on the number of students 
enrolled in a visiting professor’s course. Often the result of such a model implementation is certificates 
of additional education received. International education may exist as an inclusive education program. 
By participating in this program, a student studies at a leading university and receives a diploma, while 
participating in a course offered by a partner university, with the subsequent issuing of a certificate of 
additional education. Examples of such a model can be found in almost every Russian university, where 
foreign teachers work. Leading universities implement various programs for foreign teachers’ recruitment 
(Fellow, Post-Doctoral Fellow, or Visiting Professor programmes). 

Academic Joint Venture Model is implemented in joint educational programs with double and 
multiple diplomas granted. At the same time, students have the opportunity to study full-time at least one 
or two semesters in a foreign university that is a partner of their national university. Graduates receive not 
only a “double set” of knowledge and competencies, but also a double diploma. This model is called the 
model of joint educational programmes, while it comes to the joint participation of two or more educational 
organizations in the design and implementation of the curriculum. 

An alternative to this model can be a double diploma programme. Such programmes are 
characterized by the standards of terms and documents about education - a student studies at a foreign 
university for a long time and gets two diplomas of higher education. At the same time, the areas of 
training and majors can both coincide or vary. A student is enrolled in both universities simultaneously or 
sequentially and can study according to a jointly developed integrated curriculum. The economic effect of 
joint educational programs is associated with various options for tuition fee, but the greatest efficiency is 
in all educational organizations participating in joint educational programs promotion. 

Partnership, Alliance & Consortia Model is considered as the basis for any interaction programs 
between educational and scientific organizations. Bilateral and multilateral agreements are signed, 
scientific and educational clusters are formed, including joint research projects, business incubators, and 
support for talented young scientists and entrepreneurs. In theoretical review, such a model is called a 
network university. This title contains an emphasis on educational activities, although network universities 
are also involved in science and entrepreneurship. Within the framework of network universities, 
educational programs are implemented, with pre-university training, summer schools, language courses, 
cultural exchange programs of particular importance. 

Foreign Campus Model is a network of central university foreign branches with a developed network 
structure and general educational programs. Students get the opportunity to study at a university abroad 
remaining in their own country but participating in the work of this university branch or affiliation. According 
to the definition given by The Observatory on Borderless Higher Education experts, “a foreign branch of 
the university is its unit that meets the following criteria: managed directly by this university or jointly with 
a foreign organization, but on equal terms and acts on behalf of this university; graduates of the branch 
who study only in their country receive exactly the same diploma as graduates of the head university” 
(Bischof, 2014, p.16). 

The sixth model which can be added to this description in modern conditions has received 
extremely widespread development — is Cross-border Online Education Model. Depending on the goals 
of the educational process, each educational institution can diversify its own online teaching and learning 
in its programmes. Undoubtedly opportunities given by online teaching, gamification, virtualization and 
digitalization in education allow overcoming time and space, decrease academic restrictions, provide 
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greater accessibility to special needs students compared to off-line classes. New technologies widen 
horizons and provide for internationalization of education all over the world. 

Globalization helps with the transition to a digital academic environment, with corresponding digital 
competencies development of all the participants in the educational process. Digitalization along-side with 
globalization can completely change educational environment, the way of learning; competencies to be 
developed, educational institutions and criteria for evaluating students’ success and progress. “Promising 
areas of digitalization are the use of simulators, project and collaborative learning technologies, adaptive 
and intuitive educational environment, mobile training applications, remote and virtual laboratories, and 
publicly available research data accumulation” (Barabanova et al., 2019, p. 94). Transition to digital 
education advantage is the development of general cultural competencies. All the gamers on this field 
improve their skills in solving problems, making decisions, processing information, communication, 
teamwork, understanding, self-knowledge and self-develooment (Makarova and Makarova, 2018, p. 
0/7). The e-learning in European Higher Education Institutions report (Gaebel et al., 2014) notes that 
students with disabilities are interested in international online education, foreign students who choose 
Online education as a more affordable alternative to full-time study abroad, working students and trainees 
advanced training, unemployed retraining, graduate students and adults who consider learning as leisure 
training. 

There are several reasons that determine online education growing popularity. A significant impetus 
to its explosive growth was created by the situation of the forced self-isolation and the development of 
distance learning technologies during the COVID-19 corona virus pandemic. However, even before the 
pandemic, the online market of educational goods and services annual growth was registered at the level 
of 1.5-2%. This can be explained by the fact that online education makes it possible to get enrolled in a 
foreign university course, to listen to lectures and to go to classes, to receive foreign certificates, degrees 
and diplomas without leaving the comfort of your house. 

According to Internet World Stats, the Russian-speaking audience of Internet users is growing 
rapidly. In 2020 its number was more than 116 million people, which is 2.5% of all Internet users, and has 
significant growth indicators. The leaders in this regard are English and Chinese languages. Based on 
this, one can talk about so the need to develop online courses in English and Chinese. 

The priority state project “Modern Digital Educational Environment in the RF” sets goals to bring 
the number of online students up to 11 million people, and to develop at least 4,000 online educational 
courses and programs. For this project implementation, it is planned to attract 3,200 million Russian rubles 
from budgetary and extra-budgetary funds, the allocation of grants to form a system of requirements for 
the legal, organizational and technical support of online educational programmes, to assess their quality, 
and to improve teachers’ qualification in online teaching. 

Each of international and export of educational services models described above poses the issue 
of promoting educational services abroad and attracting foreign students. To attract foreign students and 
to diversify the number of participating countries, universities use various forms of recruiting: educational 
exhibitions and fairs; competitions, creative contests, career counselling events; online recruiting tools, 
posting information on social networks, the mass media; expanding opportunities and conditions for 
foreign students employment; national state and commercial educational portals together with international 
educational agencies and global students exchange programmes; designs of official university sites both 
in national and English languages; brochures and leaflets for foreign students distributed in embassies, 
representative offices and other state and public structures abroad; participation in international ratings, 
national scholarship programmes, spreading information through associations of foreign graduates; active 
marketing of educational programmes; and participation in network universities. All these increase the 
international recognition of educational institutions, contribute to educational services abroad promotion, 
and increase education exports. 


Results 


Taganrog Institute of Management and Economics in Taganrog, Russia has majors in economic 
sciences and law. Its graduates are highly qualified specialists of a new generation who can easily adapt 
to the system of market relations, solve legal and financial issues in a modern way, and apply new 
technologies. International activity is one of the priority areas because it makes possible an exchange 
of scientific and cultural information, study of country’s economic and political structure, and educational 
space possibilities expansion. With a bachelor’s degree graduates can continue studies abroad. 

TMEI entered into agreements with foreign educational organizations, including Bergstadt 
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Gymnasium (Germany), Logos Centar and Center for Business Studies colleges (Bosnia and Herzegovina), 
Janos Kodolanyi University of Applied Sciences (Hungary). The exchange of students and teachers 
through the use of joint international projects is very productive for solving assigned tasks in cooperation. 

Each of the selected alternatives corresponds to one of the models of higher education 
internationalization and educational services export described above. Summer courses are the 
implementation of the export model, visiting professors’ lecturing is associated with the import model, 
online courses implement the e-learning model, and double degree programs are the academic joint 
venture model (Fig. 7). 
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Figure 7. The relevance of the proposed measures and models of internationalization of education 


Competencies necessary to comply with the requirements of new tendencies are project activity 
participation, team-work abilities, systemic thinking, time and process management, decision-making 
skills, intercultural and interlingua communication, English language oral skills, multifunctional and all- 
purpose universality in uncertain situations. 

All the criteria of the international education successful model are ranked by their importance; the 
most important is compliance with the national educational policy, less important one is appeal for students 
and the least important is the cost of one student's training. As the basis for the analysis the criteria of 
cost, students’ number, competences, training time, diploma/ certificate, students’ interest, flexibility were 
taken. These criteria and values are presented in the Table 2. 


Table 2 
Description of criteria and their significance 


a Goal weight Normalized weight 
Criteria Goal name 


factor factor 
cost To minimize cost 4 0.2 
students’ _ 
To maximize the number of students 2 01 
number 
compe- To raise the compliance with the national educational project ; 025 
tences (competences number) 
To minimize the time of training /to maximize the training 
time 4 0.2 
intensity 
diploma/ : ' 
To increase the importance of diploma, degree or certificate 2 0,1 
certificate 
interest To maximize the appeal for students 1 0,05 
flexibility To maximize the flexibility 2 0,1 
TOTAL SUM 20 i 


As it can be seen from the data presented in Table 2, the most important criteria are competencies, 
costs, and time of training. The least important are interest, students’ number and the course flexibility. 
The description of alternatives is presented in Table 3. 


Table 3 
The description of alternatives according to the selected criteria 
Criteria Summer courses Visit-professor Double diploma Online courses 
training cost per 1 student 1600 rub 6000 rub 100000 rub 1000 rub 
students’ number 15 0) a 50 
competences 3 competences 2 competences 4 competences 3 competences 
time AQ) h/2 weeks /2 h/1 month 6/12 month 2-600 h/ 1-6 month 
diploma/degrees/ certificate certificate certificate diploma certificate/diploma 
interest high middle middle high 
flexibility high low low high 
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The results are based on the opinions of experts who have had an extensive experience in the 
sphere of international higher education (over 15 years). In total, 5 experts took part in the study. Data 
obtained from the experts’ analysis are averaged and presented in Table 4. 


Table 4 
Pros and Cons Analysis of Educational Models 
Pros Cons 
Cross-border online courses for international students 
using the latest digital and communications technology long preparatory work 
there are no problems of life and leisure of students costs of the latest hardware and software 
no need to change place of residence additional costs for promoting online courses abroad 
distance learning lack of Immersion in the linguistic and cultural environment 
Double diploma programs 
two higher education diplomas at the time of receiving one Students are not ready for double study load 
world level education students need to leave home for 1-2 years 
— , long preparatory work (conclusion of contracts, paperwork, 
individual learning path 
etc.) 
professional knowledge in different languages the need to solve domestic problems 
Visiting professor invitation 
teacher Is a native speaker of a foreign language embedding a course in a traditional learning system Is needed 
possibility of informal communication with a foreign teacher foreign teachers need high salaries 
the opportunity to establish international relations with foreign —saddifional costs for adaptation, life and leisure of a foreign 
universities teacher 
Summer courses 
flexible program short term 
high interest of students difficult to find teachers for the summer 
high intensity additional costs for providing life and leisure for students 


immersion in the linguistic and cultural environment 


For comparison of international education different models’ advantages and disadvantages different 
methods of analysis were applied in our study. The first one is called The Pros and Cons Analysis. It is a 
qualitative method of analysis comparing positive with negative aspects). Experts in correspondent field 
compile lists of pros and cons on strengths and weaknesses basis for each alternative. 

The second method used to evaluate different models of international education was the Kepner- 
Tregoe Method used in decision-making activity. It provides assessment criteria for information collection, 
systematization and evaluation before making a decision. “The Kepner-Tregoe decision-making method 
based on the ultimate goal of any decision becomes the best choice of possible options, it must be noted 
that it is the “best”, but not ideal in this situation. Despite the comparative analysis of solution options, the 
risk remains. Using the Kepner-Tregoe matrix reduces the risks associated with making a wrong decision” 
(Kepner-Tregoe Portal ). 

By using Pros and Cons Analysis we show that each international educational model has advantages 
and disadvantages in its activities. For comparative analysis, it is necessary to identify priority assessment 
of less important criteria. This can be done with Kepner-Tregoe method (Table 5). 
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Table 5 
Kepner-Tregoe matrix of Cross-border online courses for international students. Description of 
factors and their significance 


Criterion Importance Description Score Total 
competences 9 middle f 63 
revenue per 1 student ] 1000-5000 rub a 64 
time f 72-600 h/ 1-6 month a) 35 
flexibility 6 high g a4 
diploma’ certificate 6 diploma/ certificate Q 30 
students’ number i) 20 10 60 
interest rs) high g A5 

cost per 1 student i) 1000 rub 10 aU 
401 


All the criteria were analysed and evaluated by experts according to their significance. The totals 
were calculated by multiplying the rank of each criterion by the score of each criterion alternative, as a 
result total estimates were obtained. The analysis of cross-border online courses programmes results and 
evaluation are presented in Table 9. 


Table 6 
Kepner-Tregoe matrix of Summer courses for international students. Description of factors and 
their significance 


Criterion Importance Description score Total 
competences 9g middle f 63 
revenue per 1 student ] 2000 rub Q 64 
time - 40 hi? weeks o a) 
flexibility 6 high 10 60 
diploma/ certificate 6 certificate 2 1? 
students number i) 15 f A? 
interest a high i) AS 
cost per 1 student rs) 1600 rub Q At) 
382 


“To fill in the matrix for each alternative, various digital indicators are determined and the value 
for each factor is calculated, followed by the weight of each solution. In Kepner-Tregoe analysis each 
evaluation criterion is first scored based on its relative importance to the other criteria (1 = least; 10 
= most)” (Egorova and Makarova, 2020). According to expert evaluation and after different methods 
application, for foreign students’ benefit summer courses (382 points) and cross-border online courses 
(401 points) were considered the most relevant way of educational services export. 


Discussions 


When actual numerical data are unavailable, subjective reasoning, opinions, and/or consensus 
scoring can be substituted and documented in the final report instead. Research has demonstrated 
that simplified decision analysis methods (SMART) are robust and replicate decisions made from more 
complex analysis with a high degree of confidence. 

The experts involved in the study were specialists in the field of higher education with extensive 
experience in higher education institutions (over 15 years). In total, 5 experts took part in the study. All 
data obtained from experts were averaged and presented in tabular form. 

The Simple Multi Attribute Rating Technique (SMART) (Baker et al., 2002) utilizes simple utility 
relationships and simple scale. Five, seven, and ten point scales are the most commonly used. The 
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SMART methodology allows using less of the scale range with data not discriminated adequately. 

For the basis of the analysis we take the criteria of cost, students’ number, competences, training 
time, diploma/ certificate, students’ interest, flexibility. Weighted criteria estimates are summarized in the 
totals shown in Table 7. 


Table 7 
Rank factor estimates of the Simple Multi Attribute Rating Technique (SMART) factors 
Criteria Summer courses Visit-professor Double diploma Online courses 
cost 4 3 | 9 
students’ number 4 1 | _ 
competences 3 2 5 4 
time 9 4 | 2 
diploma/ certificate Z 1 5 3 
interest 4 3 2 4 
flexibility 4 2 2 4 


A performance rating scale of 1-5 is used when a rating of “1” always means worse performance 
(0), and a rating of “5” always means better performance (1). The normalized values in Table 3 are 
converted to usable values from 0 to 1 (1 =0, 2=.25, 3 = .5, 4 = .75, 5 = 1.0). Weighted criteria estimates 
are summarized in the totals shown in Table 8. 


Table 8 
Utility values of the Simple Multi Attribute Rating Technique (SMART) factors 
Criteria Summer courses Visit-professor Double diploma Online courses 
cost 0./9 0.5 0 { 
students’ number 0/9 () () | 
competences 0.5 0.25 | 0.f9 
time | 0.79 0 0.29 
diploma/ certificate 0.25 () | 0.5 
interest 0.19 0.5 0.29 0.9 
flexibility 0.19 0.20 0.29 0.9 
4,75 2,29 2,0 a 
0,68 0,32 0,36 0,71 
67,9% 32,1% 30, ! Yo 71,4% 


The results of calculations are presented in Table 8 and show the highest utility ratings received by 
two of the alternatives we proposed - summer courses (67.9% utility) and online courses (71.4% utility). 
Thus, it is necessary to choose summer and online courses as the best alternatives. 

After comparative analysis of international educational activities in higher education has been 
accomplished, summer courses and cross-border online courses have proved to be the most effective and 
efficient way of getting higher education abroad. To improve the management of international activities, 
new forms of international student exchange and other options for exporting educational services have 
been proposed. Pros and Cons Analysis revealed the advantages and disadvantages of the proposed 
areas of development. Kepner-Tregoe Analysis and Simple Multiple Attrioute Evaluation Method allowed 
evaluating these alternatives by the criteria cost, students ‘number, competences, training time, education 
document, interest for students, program flexibility. The most effective ones are summer courses and 
e-learning programs. Using these forms of international student exchange will attract new foreign students 
and increase the level of TMEI income from the export of educational services. 


www.ljcrsee.com 
88 


Makarova et al. (2021). International student exchange management as factor of educational services development, 
International Journal of Cognitive Research in Science, Engineering and Education (IJCRSEE), 9(1), 75-90. 


Conclusions 


A theoretical analysis of key concepts in the field of international education management has shown 
that the most significant factor in international education management is the stimulation of all forms of 
academic mobility. International student exchanges contribute to advancement of educational goods and 
services in the world market and ultimately lead to the development of the export potential of the RF 
higher education. Modern programs and models for exporting educational services on the international 
education market are very diverse, but in modern conditions, universities tend to use most of them, which 
makes it possible to diversify the educational services market. 

In TMEI, international educational activities have been carried out since 1996 according to existing 
educational programs, students’ cultural and educational exchanges, visiting professors, and participation 
in international scientific and educational events. For the regional private educational organization TMEI, 
several alternatives were proposed to improve the management of international student exchanges in 
the export of higher educational goods and services. The organization of short-term summer courses for 
foreign citizens, the development of programs for cross-border online training, invitation of more foreign 
visiting professors, and the development of double degree programs were proposed. 
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Abstract: The work deals with an important aspect of teacher training — the formation of competence in the field 
of technologization of the pedagogical process. An updated theoretical model of a holistic pedagogical process is presented, 
which is the basis for coverage of the criteria for the formation of abilities for the constructive and systematic introduction of 
technologies into pre-school education. The author’s questionnaire The Scale of Self-Assessment of Pedagogical Abilities for 
the Technologization of the Pedagogical Process was presented. The article provides the results of its testing on a sample of 
a total of 412 respondents, including 170 preschool teachers with work experience from 1 to 25 years, 200 — students-future 
teachers, 42 - PEF coordinators. Based on the comparison of samples of teachers with different work experience, it describes 
how the nature of professional activity determines the specific structure of competences in the field of TPP. The experiment 
was a part of research; authors showed the conditions for the implementation of a special curriculum, which helps effectively 
prepare teachers for the use of modern educational technologies. 

Keywords: pedagogical technologies, professional competences of the teacher, methodological competence, preschool 
education. 


Introduction 


The active development of alternative forms and models of education has led to stricter requirements 
for its quality. The technological approach assumes a focus on clear measurable goals of the pedagogical 
process, which are recorded in educational standards and programs (in our case the reference point is the 
competence model of the teacher of a preschool educational institution). It is in accordance with the model 
of competencies the optimal algorithm of pedagogical actions is selected: techniques, methods, forms and 
means of monitoring outcomes. The main advantages of the technologization of the pedagogical process 
(hereinafter referred to as the TPP) are that this approach guarantees the quick achievement of the 
intended tasks, regardless of who Is the object and subject of the pedagogical influence and under what 
conditions it occurs. The extraordinary diversity of existing technologies allows us to creatively model the 
pedagogical process, flexibly adapting it to the capabilities of an educational institution and the needs 
of learners. In addition, the technological approach is a necessary condition for the effective and safe 
implementation of innovations in teaching practice. It is thanks to the clear algorithmization of actions and 
the gradual monitoring of the achievement of results that teachers can implement innovative practices, 
bearing in mind the responsibility towards children and their families. Thus, the quality of modern education 
largely depends on the ability of qualified teachers to technologize the pedagogical process. 

The pedagogical skill is determined by how much teacher is able to find an effective 
technological solution for the optimal development of personal qualities and life skills of a learner. 
Accordingly, the formation of teachers’ abilities to effectively use technology in training and education 
is an important part of vocational training. The fundamentals of this work are laid in the theory of 
the holistic pedagogical process (Khmel, 2008; Slastenin, 2005), competence-oriented approach 
(Enygin et al., 2018; Khutorskoy, 2017; Seryakova, 2016), a system analysis of pedagogical 
communication (Zarudnaya et al., 2018). The reform of higher pedagogical education in the Republic of 


“Corresponding author: rakhilaaubakirova@gmail.com 


© 2021 by the authors. This article is an open access article distributed under the terms and conditions of the 
—wue Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). 


www.ijcrsee.com 
91 


Aubakirova et al. (2021). Consideration of the basic competencies of a preschool teacher in curriculum modernization, 
International Journal of Cognitive Research in Science, Engineering and Education (IJCRSEE), 9(1), 91-103. 


Kazakhstan is accompanied by the work of many scientists: the structure of professionally significant 
qualities of a teacher is determined (Uspanov, Zhansugirova and Bissenbayeva, 2013); summarised 
the long-term experience of technologization of the educational process of universities (Kovzhasarova, 
Nurakhmetov and Aulbekova, 2005); the conceptual framework for the modernization of teacher education 
has been formulated (Praliev et al., 2015). 

The reform of the education system faces the task of preparing a “new time teacher” who is able 
to train and educate a “new time person”. Comprehensive lists of competencies recognised as necessary 
in educational systems in different countries are offered by Baumert and Kunter (2013), Blomeke (2017), 
Thrupp (2006). In addition to subject qualifications, the teacher is expected to be motivated, active in 
social communications, creative and able to act in uncertain situations. Modern researchers (Pankova, 
Luzan and Sergeeva, 2016; Sanchez-Garcia et al., 2013) indicate a willingness to innovate and a high 
level of knowledge of information and communication technologies as a universal attribute of teacher 
qualifications. 

Basic training requirements are presented in a number of academic standards: knowledge of various 
scientific approaches and methodologies in the field of professional specialization; the ability to use a 
wide range of techniques, to adapt them for creative problem solving; critically assess the short-term and 
long-term consequences of their actions (Bologna Working Group, 2005); the presence of an integrative 
understanding as a basis for the original development or application of ideas (Ministry of Education 
and Science of the Republic of Kazakhstan, 2018). The concept of higher pedagogical education of the 
Republic of Kazakhstan (Ministry of Education and Science of the Republic of Kazakhstan, 2005) identifies 
three groups of competences that a new formation teacher should possess: general cultural, subject- 
oriented and methodological (psychological-pedagogical). The concept methodological competence of 
the teacher seems extremely important and requires clarification. Mata et al, (2010) offer an operational 
model consisting of five components: ensuring the functionality of the educational process, the use of 
various teaching methods and tools in a formal and informal context, the exploitation of educational 
innovations, the management of learning outcomes, the design of teaching activities. 

The professional competencies of teachers are not limited to the knowledge of current educational 
methods and programs. It is extremely important the ability to reasonably select and flexibly adapt existing 
technologies to the changing demands of the society. We called this complex of knowledge and skills 
“the ability to technologize the pedagogical process” and consider it as one of the main professional 
competencies of a teacher. The generally accepted understanding the concept of competence implies the 
ability to use acquired knowledge and skills in a wide range of standard and non-standard pedagogical 
situations (Mulder, 2014). Accordingly, competence in the field of TPP presupposes the ability of the 
teacher to independently apply various elements of pedagogical technologies under certain conditions 
of interaction for realizing the specific goal of training and education. Recent large-scale studies have 
shown a close relationship between the level of development of competencies in the field of TPP and the 
professional and personal growth of teachers, as well as satisfaction with the profession (Kuanysheva et 
al., 2019). 

In spite of the developed theoretical and methodological basis, the TPP does not pay enough 
attention to the professional training of teachers in the preschool education system. Technologies 
are most often learned at the level of knowledge, and not at the level of competence. As a result, the 
teacher today is still perceived in society as a transmitter of information, and not as an active creator 
of purposeful pedagogical interaction. In addition, the pedagogical process is in constant development, 
being modernised in view of the accumulated experience. Accordingly, objective transformations are 
taking place in the system of professional qualities and competencies, which requires more careful study. 
In view of the events of 2020, which forced educational systems at all levels to switch to distance learning, 
this problem is becoming even more acute. 

Listed above objective problems and contradictions make relevant the purpose of this publication 
— to determine the individual abilities of teachers in the technologization of the pedagogical process in 
the conditions of preschool preparation. The research is aimed at solving the following topical issues: 1) 
What is the real level of competence of preschool teachers in the field of TPP? 2) How does the structure 
of competencies depend on the specifics of professional activity? 3) What are the most effective ways to 
acquire and improve the competence of teachers in the field of TPP? 

Practical work is based on the author's theoretical model, which has been introduced into the 
preschool education system of the Republic of Kazakhstan more than ten years ago. The results of many 
years of practice have proved its effectiveness and allowed presenting it in a more current modification 
(Aubakirova, 2011a; 2011b). 
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Author’s model of the technologization of pedagogical process 

We consider the holistic pedagogical process as a systemic category, the constituent elements of 
which are the following: conditions of education; relationships in the system “teacher-learner’; common 
goals and particular learning objectives; the content of training, which is implemented in specific means 
of pedagogical interaction; organization and management of the educational process; ways of consistent 
monitoring of performance. 

The structural elements of the pedagogical process are closely interrelated and together represent 
a dynamic cycle (Figure 1). 

The pedagogical process begins with the organization of a harmonious personality-oriented 
interaction in the system “Teachers — Pupils” (as well as “Teachers-Parents”, “Pupils — Pupils’). 
Purposeful regulation requires timely diagnostics, analysis of these relationships as a part of a holistic 
pedagogical process. Next, the teacher formulates the urgent tasks of interaction and expediently models 
the pedagogical process. The main pedagogical goals and the content of education are determined by 
external factors: the needs of society are worked out by the pedagogical community and are embodied 
in curricula and educational standards. Acting within this framework (as well as using the resources of 
a particular educational institution), the teacher is free in the means of realization — in what way the 
direct pedagogical interaction will be realised. At this stage his professional skills and pedagogical culture 
are realised to the greatest extent. Systemic management of the pedagogical process implies constant, 
phased control and timely correction of the used technology. The pedagogical cycle ends with an analysis 
of the results: in the context of the tasks set for the development of learners, the effectiveness of using 
a particular technology in these conditions, their own professional actions and their consequences. This 
allows you to simulate a new pedagogical task at a new level of relationships. 
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Figure 1. Structural components of the pedagogical process 
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Based on the presented model, we formulated the structural criteria for the formation of 
pedagogical competence in the field of TPP: 

(1) Establishment of pedagogically expedient relations. This criterion includes the following 
components: 

A) The ability to timely and accurately diagnose relationships in the system of pedagogical 
interaction. 

B) Knowledge of techniques and the ability to regulate the interaction in the educational mechanisms 
of the ECE pedagogical process. 

C) Purposeful self-improvement of the teacher based on the reflection of their own professional 
growth and personal qualities. 

(2) Modelling the pedagogical process: 

A) Awareness of the unity of the various goals and objectives of educational activities. 

B) Forecasting and design of the pedagogical process in accordance with the tasks of the 
development of preschoolers. 

C) Planning of educational activities in the framework of the approved curriculum and the specific 
conditions for their implementation in an educational institution. 

(3) The implementation of the pedagogical process: 

A) The implementation of the content of education in the context of the objectives and current tasks. 

B) Knowledge of effective means, forms, methods and techniques, the ability to apply them in direct 
work with preschoolers. 

C) Creative design of the pedagogical process when changing conditions and situations of 
interaction. 

(4) The organization and management of the pedagogical process Is associated with the constant 
monitoring of the flow of the pedagogical process, the ability to take into account the factors that impede 
or stimulate its implementation: 

A) Phased monitoring of the implementation of the pedagogical process at each stage and in each 
element, the ability to make adjustments. 

B) Tracking of pedagogical innovations. 

(5) The analysis of the implemented technology occurs systematically throughout the whole 
pedagogical cycle and includes: 

A) Analysis of the initial data and conditions of a specific pedagogical situation. 

B) Understanding the pedagogical goal and tasks at each stage and in each element of the 
pedagogical process. 

C) Further transformation of technology, taking into account the corrections made to improve the 
holistic educational process. 


Materials and Methods 


The main method of obtaining information on the formation of pedagogical competence in the field 
of TPP is self-analysis of pedagogical activity, which implies a well-developed reflection and ability for 
self-observation of the teacher. We have developed a self-reporting methodology based on the criteria set 
forth above. The scale is a screening tool that provides data on the level of development of pedagogical 
competence (as a construct of knowledge, skills and attitudes) in the field of TPP. This allows evaluating 
the effectiveness of educational and training programs aimed at developing the appropriate qualities of 
teachers. 

To measure the level of development of each component, we employed a 5-point scale, where its 
extreme poles indicated the lack of competence (0 points), and its maximum severity (4 points): 

Q — the ability is not expressed; 

{1 — the ability manifests itself sporadically, quite rarely; 

2 —the ability to manifest itself occasionally, from case to case; 

3 — the ability to manifest itself frequently, in most cases. 

4 — the ability to manifest itself consistently, almost always. 

To obtain the total score we summed the scores for all 13 items. In addition to calculating the total 
score, the analysis of answers to individual questions and blocks of the scale allows to draw conclusions 
about the structural components (abilities) in the implementation of educational technologies. Thus, we 
have the opportunity to create an individual profile of the abilities of a specialist to identify the leading 
components and potential possibilities that need to be improved. 
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Processing and interpretation of the estimates obtained was based on a direct interpretation of the 
average score, based on the values of the proposed 5-point Likert scale. We consider 1.5-2.5 points as 
an average level of competence - ability sometimes manifests itself, from case to case. In this case, we 
can talk not about a stable explicit tendency (towards the manifestation of competence or its absence), but 
about the fact that the ability is realized in certain pedagogical situations that contribute to its manifestation. 
The excess of this factor indicates the intensity of abilities and skills, a decrease indicates the insufficient 
formation of competences in the field of TPP. 

The sample was formed from “natural” socio-professional groups — teachers with different 
specializations, work experience and level of professional skills: 

(1) bachelors majoring at Preschool Education of the Semipalatinsk State Pedagogical Institute 
and the Shakarim State University in Semey (162 people): 

(2) masters majoring at Pedagogy and Methods of Elementary Education of the Semipalatinsk 
state Pedagogical Institute, 38 people, 

(3) 170 preschool teachers in Semey, who undergo refresher courses (we divided the sample into 
two subgroups: with work experience up to 10 years and from 11 to 25 years); 

(4) methodologists of preschool educational institutions, PEF coordinators - participants of seminars 
of international project TEMPUS EDUCA JEP 517504 at Shakarim State University (42 people) 

Participation in the study was voluntary. All respondents gave their consent to the processing and 
use of personal data. 

According to the results of diagnostics, we calculated descriptive statistics. An assessment of the 
individual points of the scale in different samples was also carried out — thus conclusions were made 
about the structure and dynamics of the formation of individual components of teachers’ competence in 
the field of TPP. 

Considering that a teacher should be an expert in a wide range of methodological areas and be 
ready for introduction of innovative educational technologies, we have developed a special training course 
“Modern educational technologies in the system of a teacher's professional activities” (in collaboration with 
A. Magauov and Sh. Duisembekov). The objectives of the course: to reveal the essence of educational 
technologies; to form the ability of teachers to use them in practice; to promote the development of a 
creative and constructive approach to teaching. The material of the special course Is organised in three 
modules: Education technology conceptual basis, Personalities of a teacher and learners in the education 
technologies system, Didactic design of education technologies. The volume of material includes 14 hours 
of lectures, 10 hours of seminars, 6 hours of practical training. 

The program has been tested on a selection of undergraduates in the specialty Pedagogics and 
Primary Education Methodology at the Semipalatinsk State Pedagogical Institute (two groups with a total 
of 38 people). A teaching experiment was organised as follows: in the experimental group, the course 
was introduced during the first semester of the school year, in the control group it was transferred to the 
schedule of classes in the second semester. Thus, we were able to record the results of the implementation 
of the curriculum and analyse its impact on the formation of competences in the field of TPP. 

For starting and final measurements the self-assessment scale of pedagogical skills for the TPP 
presented above was used. Sample rates were calculated for different professional groups, the reliability of 
measurements was verified. Inferential statistics were used in addition to descriptive statistics. Statistical 
analysis was performed using the nonparametric tests that allow comparing small groups and ignoring 
deviations from the normal distribution: Wilcoxon T-test for measuring the shift in values as a result of 
training, and Mann-Whitney U-test for comparing control and experimental groups. 
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Results 


1. Identification of the formation of the ability to technologise the pedagogical process 
among teachers of the preschool education system 

First of all, we have calculated the total score of the self-assessment scale of abilities for the TPP. 
These data are the basis for the development of group test standards in evaluation of the studied abilities 
in different selections — Table 1. 


Table 1 
Data descriptive statistics of the total score of the scale of self-assessment of the abilities of the 
TPP the selections of teachers with different experience 


No Selection of teachers: N sanamesion M sD SE 
(min-max) 

1 bachelors — prospective teachers 1b? f-74 14455 344 O77 

si masters — prospective teachers 36 O-2 5) 16,386 416 067 

teachers/educators of PEF (preschool educational 1/0 44.34 4265 4276 O42 
institutions): 

- track record 1-10 years fe 10-28 1966 330 0.38 

= - track record 11-25 years sis) 13-34 2o6o 42f O43 

PEF coordinators 4) 17-29 2afi 2755 O43 


selected rarely give themselves a score above 2 points. This indicates a lack of capacity 
development in the field of TPP. We see that teachers and practitioners with experience of more than 10 
years are most confident in their competence in application of educational technologies. Approximately 
the same average results show selected teachers with experience of 1-10 years and methodologists of 
preschool institutions. At the same time, in the selection of methodologists, the smallest data scattering is 
that none of the respondents showed a low level of parameter expression. It is expected that the lowest 
indicators of the formation of pedagogical abilities in TPP were found among students — future teachers 
(bachelors have lower rates more often than masters). 

The calculated Cronbach's Alpha was 0.895, which indicates a high internal consistency of the 
scale. 

The distribution of estimates for individual points of the scale in different selected people is in some 
way interesting. Table 2 presents the average arithmetic for questions. 
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Table 2 
Average estimates of individual criteria for pedagogical abilities for the technologization of the 
pedagogical process in different selected persons 


er ; ‘ Average marks of selected Lsd. 
Criteria of evaluating pedagogical competence in the field of 
No teachers* (N=412) 
TPP _— <= =a sae aaeee 
1 2 3 = 0 all 
| Able to timely and accurately diagnosing relations in “educator 
06 O09 %14 %18 18 1.37 
— learners’ system 
2 Able to adjust the interrelating mechanisms of the education pro- 
09 11 #16 22 21 1.46 
cess 
a Make constant efforts for self-improvement both personal and 
; Lf 619 0~6 615061918 1.63 
professional one 
4 Aware of the common purpose of the education process, able to 
16 #619 #%16 2 #2? 2.01 
single out concrete tasks for implementaton 
0 Able to project pedagogical interrelation and able to forecast the 
22 22 2 22 2a food 
results of application of technologies 
6 Now how to reach the needed results in specific conditions of 
af 15 #15 18 22 26 1.99 
activity 
f Select and apply affective means and technic of the pedagogical 
shi ie 12 iF 2106 248 2? 24 
interrelations 
o Adjust and make up creatively the teaching process, in course 
OF 11 716 #41) (19 1.60 
of change of the educating situation conditions 
9 Control the education process at each stage and each element 
130614 «~6«27«6 18 O18 1.41 
makes corrections 
10 = =Master the ways to organise pedagogical activities in scientific 
05 O06 OF 1 1.1 0.95 
manner 
11s Analyse the inputs and conditions of a specific pedagogical sit- 
: : : pedagog 1 12 O88 «1 12 0.97 
uation 
12 Able to think over each aim and task at every stage of education 
07 O8 #117 #1d 1.6 1.16 
process 
12 =Able to transform and to adjust the technologies in order to im- 3 
02 O05 15 22 14 1.08 


prove the comprehensive educating process 
*The numbering of the selected people is as follows: 1 — bachelors; 2 — masters, 3 — teachers with experience of 1-10 years; 
4 — teachers with experience of 11-25 years: 5 — preschool methodologists. 


Based on the data obtained, the most problematic components of the TPP among teachers are 
proficiency in the methods of scientific organization of pedagogical work (paragraph 10, Lsd=0.95), 
analysis of the initial data of a particular pedagogical situation (p.11, Lsd=0.97) and transform technologies 
to improve the holistic pedagogical process (p.13, Lsd=1.08). The respondents use these competencies 
and abilities extremely rarely, or do not use them at all. The construction of expedient activities requires 
more close attention, that is, an understanding of the pedagogical goals and objectives in each element 
of the educational process (p.12, Lsd=1.16). 

In general, the results show a lack of ability to system analysis of the entire pedagogical cycle in the 
general structure of pedagogical competence in the field of TPP. 

When analysing the estimates of points, the specificity of different selected people is clearly visible: 

¢ Bachelors have lower marks on most points of the scale compared to masters. In general, 
the future teachers are characterised by insufficient formation of the ability to establish pedagogically 
expedient relations with pupils. Interestingly, they overestimate their abilities to analyse the initial data of 
the pedagogical situation, to design the pedagogical process and to predict the result (p.5 and p.11 of the 
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scale is the average assessment at the level of teachers with work experience of over 10 years). 

¢ Young teachers with experience from 1 to 10 years are less than the rest make efforts for 
continuous personal and professional improvement (p.3, Lsd=1.5). In this group, the lowest estimate of 
the ability to design the pedagogical process according to the set goal and predict its results was obtained 
(p.5, Lsd=2.0). Estimates of the remaining pedagogical abilities are significantly increased compared with 
the students, but less pronounced than in the group of experienced teachers. 

¢ Experienced teachers with work experience 11-25 years demonstrate the highest ability to 
regulate the interaction between the participants of the holistic pedagogical process (p.2, Lsd=2.2); to the 
effective selection and application of training and education facilities (p.7, Lsd=2.8); to the transformation 
of the technologies used (p.13, Lsd=2.2). A distinctive feature of the selection is a flexible, adaptive and 
creative design of the pedagogical process taking into account the real conditions of the pedagogical 
situation. It is this ability that they note as the most frequently used in the work (p. 8, Lsd=3.1). 

¢ Methodologists of preschool institutions have a characteristic structure of abilities, in which the 
component of the modeling the pedagogical process prevails. They realize the goals and objectives of 
the pedagogical process better than all the other categories of specialists, and accordingly design it 
(p.4, Lsd=2.2); know what means to effectively implement the content of education (p.6, Lsd=2.6); able 
to predict the results of the application of technology in specific conditions of activity (p.5, Lsd=2.4). The 
whole range of pedagogical competencies in the field of TPP is developed at a fairly high level. Slightly 
lagging behind is the possession of the methods of the scientific organization of pedagogical work (p.10, 
Lsd=1.1). 

The data obtained clearly demonstrate how the specificity of professional activity influences the 
development of individual components of the competence of teachers in the field of TPP. In addition, we 
found out the role of vocational training in the formation of these abilities. 

2. Formation of abilities and competencies of teachers based on the concept of 
technologization of the pedagogical process 

Formative influence occurred in the selection of masters, who during the 30 academic hours 
mastered the special course “Modern educational technologies in the system of professional activity of a 
teacher.” The diagnostic results in the control and experimental group are presented in Table 3. 


Table 3 
Statistical significance of differences in the level of ability to technologize the pedagogical process 
in the experimental and control groups 


N Ml oD Sum of Ranks UW Mann-Whitney Asymp.sig. (2-tailed) 

Primary diagnosing 
Control group 9 1489 371 361.5 

; 171.5 0.790 
Experimental qroup 19 i454 4.07 379.5 
Secondary diagnosing (after the training) 
Control group 19 15.05 23.64 200 

2 o8 0.014 
Experimental qroup 19 17568 444 453 


The level of the studied phenomenon in the experimental and control groups during the initial 
diagnosis was the same. In the control group, we observe a slight increase in the indicator due to the 
natural development of professionalism of future teachers in the process of training in the magistracy. At 
the same time, the level of development of competencies in the experimental group significantly increased 
after passing the training course. As a result, the groups began to differ significantly in the value of the 
parameter (p = 0.014). After the experiment, the general level of abilities to the TPP in the experimental 
group exceeds the level in the control group. 

Following the principle of phased control of the results of the use of educational technology, we 
carried out diagnostic measurements at each stage of the formative experiment. This allowed us to trace 
the dynamics of changes in abilities to the TPP (Figure 2). 
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Figure 2. State of competency of the investigated phenomenon in experimental group (N=19, in %) 


As a result of the training course in the experimental group, the number of teachers with high self- 
esteem in the field of TPP gradually grew. At the end of the experiment, it reached 23%. It is important 
that the greatest increase occurs at the second stage of training, when practical exercises begin using 
active technologies. At the same time, the number of teachers with a low level of competence decreased 
from 33 to 17%. 

Thus, as a result of mastering the special course “Modern educational technologies in the system of 
a teacher's professional activity”, future teachers have the pronounced positive dynamics in the formation 
of competences in the field of TPP. 


Discussions 


Approbation of the questionnaire “The scale of self-assessment of pedagogical abilities for the 
technologization of the pedagogical process” showed high internal consistency of items, which indicates 
the reliability of the measurement. The common basis for the set of questions also indirectly confirms 
the proposed theoretical model of the TPP criteria. Analysis of means confirmed assumption that the 
professional competencies of preschool teachers are insufficiently developed. 

An important result concerns the relatively low indices of abilities to the TPP among young teachers 
compared with university graduates. This fact can be explained with the help of the Daning-Kruger rule 
on metacognitive distortion, as a result of which specialists with low qualifications make erroneous 
conclusions about their own capabilities to design and regulate pedagogical interaction. Facing real 
professional situations, young teachers are aware of their own limits and mistakes, as a result of which 
the self-assessment of competencies decreases. In the group of experienced teachers, the high grades 
reflect an objective growth of professional skills. 

The data of Hoy and Spero (2005) confirm the increase in self-efficacy during the training of future 
teachers. Therefore, when introducing professional development programs, one should pay attention 
to the adequacy of teachers’ self-assessment and develop their ability to self-knowledge. Undoubtedly, 
knowledge of their potential internal resources, abilities and limitations determines the increase in 
responsibility and the desire of teachers to actively participate in their own development. Thus, the nature 
of the professional activities of teachers determines the structure of competences in the field of TPP. The 
ability to constructively use pedagogical technologies can be purposefully developed, which is confirmed 
by the results of a teaching experiment. Among modern ways to improve the pedagogical process, the 
theory and methodology of pedagogical innovation should be noted (Hannan, 2005; Walder, 2014), the 
introduction of public distance learning, e-learning (Bidin and Ziden, 2013; Fominykh et al., 2016); defining 
the teacher's ethical profile (Jeder, 2013). 

A characteristic feature of the dynamics of the formation of skills in the process of mastering the 
special course is the practical orientation of the activity. Opinion about the importance of the workshop in 
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teacher training has been repeatedly expressed in pedagogical science and found numerous empirical 
evidences. It is necessary to recognise that the process of teaching practice needs more thorough 
structuring and technologization. In the preparation of teachers, it is necessary to focus on the ability to 
design the pedagogical process in accordance with actual tasks. In addition to clear target orientations 
of vocational education, it is important to use precisely those methodical techniques and practices that 
teachers will later implement in the training of children. We believe that this is the most optimal and 
effective way to show how the technology works, to reveal its advantages and limitations, to finally form 
methodological competence of teachers. 


Conclusions 


surveyed Kazakhstan's preschool teachers are not confident enough in their abilities and 
competencies in the field of technologization of the pedagogical process. The indicators of self-assessment 
of pedagogical abilities for the technologization of the pedagogical process increase with increase of the 
level of education and professional experience. 

The structure of abilities differs significantly among teachers with different work experience. The 
position of methodologists implies assistance to teaching staff in the specification of the content, methods 
and means of training. They often develop information and teaching materials and rarely communicate 
directly with children and parents. This imposes a specific imprint on the structure of competences in the 
field of TPP (the predominance of the components of the educational process modelling). Methodologists 
significantly lag behind practicing educators in their ability to adaptively design the pedagogical process, 
to select effective methods and techniques in a real situation of interaction. That is, the transformation of 
technology, their creative application occurs in practice, with the accumulation of experience working with 
various techniques. This is important to consider in order understanding the nature of innovation. 

To reach an adequate level of these qualities, it is necessary to provide special training, which 
necessarily provides for the use of active teaching methods (acquiring relevant attitudes, knowledge, and 
approbation of skills). Particular attention in this issue should be paid to a system analysis of a holistic 
pedagogical cycle, an understanding of pedagogical goals in each element of the educational process, 
as well as the ability to transform existing technologies to achieve the set objectives. The competences 
further improve directly in the professional activity, in solving real pedagogical problems, and conscious 
self-development. 


Limitations 
Although the problems described are of a global nature, the empirical results obtained refer to the 


surveyed Kazakhstan's preschool teachers and students. We expect a change in trends in the process of 
gradual reform of the system of professional training of teachers. 
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Appendix A 

Scale of self-assessment of pedagogical abilities for the technologization of the pedagogical 
process (stimulus material) 

Instructions: You are offered a number of questions that relate to the ability to practical implementation 
of various educational technologies in the educational process. Remember your individual experience 
and evaluate how often this or that ability manifests itself in your work. 


Ne Self-Reporting Points Rating Scale 


| am able to diagnose in time and accurately the relationship in the system 
‘teacher-pupils” 

| am able to regulate interactions in the educational mechanisms of the pedagogical 
process 


3 | make a focused effort to continually self-improve, both personally and professionally oO 4d? 3 4 


| realize the general goal of the pedagogical process, | can identify specific tasks for its 
achievement 

| am able to design pedagogical interaction according to the set goal, | predict the result 
of using particular technology 


6 ~=6| Know how to implement the content of education in specific conditions of activity f df? 9 4 
7 | select and apply effective means, forms, methods and techniques of pedagogical a a ee 
interaction 


| creatively adapt, construct the educational and educational process when the initial 
conditions of the pedagogical situation change 

| exercise control of the pedagogical process at each stage and in each element, mak- 
ing adjustments 


10 [possess the methods of scientific organization of my pedagogical work Oo 4d? 9 4 


11.‘ | analyse the initial data and conditions of a specific pedagogical situation. oO df? 3 4 


‘ | interpret the pedagogical goal and tasks at each stage and in each element of the eS oh oe OH ok 
pedagogical process 


‘ | am able to transform and adapt technologies in order to improve the pedagogical . 2 woe cA 
process 
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Abstract: The purpose of the research was to determine the secondary school students’ attitude and motivation 
toward STEM. For this purpose, two field studies for developing a survey were conducted. The first field study, pilot study, 
was performed for collecting the research data and making statistical analysis of the research data. After completing statistical 
analysis procedures (Explanatory Factor Analysis and Confirmatory Factor Analysis) of the pilot survey, the reliability and 
validity of the pilot survey was calculated. The statistical results indicated that the pilot survey was reliable and it also had four 
sub-factors. The second field study, main study, was performed for comparing and discussing the research data. The research 
was applied to 2912 students at different 14 secondary schools during the academic year of 2018-2019 at Izmir, Turkey. The 
Students’ results in the metropolitan and suburban regions of the city were compared. The results indicated the decrease in 
the attitude and motivation of students at higher levels in both regions toward STEM. When the results of the research were 
evaluated in terms of the sub-factors, the science and engineering values of secondary school students in the suburban were 
higher than the values of the students in metropolitan. It was not found a significant difference between the students’ technology 
and mathematics values for both metropolitan and suburban. There was a significant difference between the 7" grade students’ 
science, technology, engineering, and mathematics values instructed in metropolitan and suburban in favor of the students 
instructed in suburban. It was calculated that there was not a significant difference between the 6th and 8" grade students’ 
all values for both the regions. It was only calculated that there was a significant difference between the 5" grade students’ 
mathematics value. Investigations on gender factors showed that the female students’ science, technology, engineering, and 
mathematics values were generally lower than the male students’ values for both the regions. 
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Introduction 


All countries need a broader and more coordinated teaching strategy in science, technology, 
engineering, and mathematics (STEM) at all levels from primary to university education. The teaching 
strategy in all the STEM disciplines should be to “address the need for greater diversity in the STEM 
professionals for a workforce with deep technical and personal skills, and for a STEM-literate citizenry 
prepared to address the grand challenges of the 21st century” (Bybee, 2010a, p.996). Sanders (2009, p.21) 
defined STEM education as “approaches that explore teaching and learning between/among any two or 
more of the STEM subject areas, and/or between a STEM subject and one or more other school subjects”. 
Kelley and Knowles (2016, p.3) determined “integrated STEM education as the approach to teaching the 
STEM content of two or more STEM domains, bound by STEM practices within an authentic context for 
the purpose of connecting these subjects to enhance student learning.” Brown et al. (2011, p.6) defined 
STEM education as “a standards-based, meta-discipline residing at the school level where all teachers, 
especially science, technology, engineering, and mathematics (STEM) teachers, teach an integrated 
approach to teaching and learning, where discipline-specific content is not divided, but addressed and 
treated as one dynamic, fluid study”. At this point it is essential to focus on integrating different disciplines 
in modern education settings. Breiner et al. (2012) reported that it is difficult to concentrate with different 
disciplines in contemporary curriculum programs, these disciplines are not independent majors therefore 
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each discipline is able to be thought of as a cluster. Educators and researchers can focus on combining 
four disciplines and bridging the relationships among four disciplines in today’s technological world 
(Sanders, 2009; So et al., 2018). 

The main purpose of STEM education is to foster qualified and skilled manpower (Luo et al., 2019). 
Also the purposes of STEM education are to develop industry and technology, to raise welfare levels, to 
increase literacy rates, etc. (Christensen, Knezek and Tyler-Wood, 2015; Hanson and Krywult-Albanska, 
2020; Unfried et al., 2015). 

Bybee (2011, p.6) determined that integrated STEM education focuses on eight factors which 
are “asking questions and defining problems, developing and using models, planning and carrying out 
investigations, analyzing and interpreting data, using mathematics and computational thinking, constructing 
explanations, designing solutions, engaging in argument from evidence, obtaining, evaluating, and 
communicating information”. Students may begin to learn by becoming aware of the eight fundamental 
factors. Students may understand how to improve the design, inquiry, and analysis process and how to 
combine innovation and technology in a true STEM education environment. Students are able to study on 
projects and laboratory investigations with the STEM curriculum in cooperative learning groups. Besides, 
teachers may explain to students what they are to do and how they are taught in these education settings 
in order to develop deeper and richer understandings and abilities (Hasanah, 2020; Li et al., 2020; Margot 
and Kettler, 2019). 

STEM helps students improve 21 century skills covered flexibility, adaptability, creativity, 
information resources management, media and technology literacy, self-management, social skills etc. 
and specifically ensures that students are sensitive citizens about energy efficiency, air and environmental 
pollution, climate change, use of natural sources, national security, personal healthy, economics, politics, 
and cultural values, personal, social and global issues, etc. STEM also makes significant contributions to 
the importance of science, the emphasis of technology, and the recognition of engineering in all school 
programs (Bybee, 2010b; Sanders, 2009). 

STEM will play an important role in students’ career choices nowadays and in the near future. Many 
students will generally focus on STEM-based jobs instead of natural sciences, medical fields, engineering 
jobs. Employers in industries will also consider qualified workers with STEM-related skills for filling empty 
and critical positions (Abe and Chikoko, 2020; Brown et al., 2011). Therefore determining and guiding 
students’ academic choices are quite important at the primary and/or secondary school levels in today’s 
world. The academic choices of students have lately been begun to investigate in depth by researchers 
(Craig et al., 2018; Maltese and Tai, 2011; Sadler et al., 2012; Unfried et al., 2015). 

Integrated STEM education plays an important role in improving students’ problem solving 
skills, creative thinking, social skills, communication and collaboration skills, self-management skills, 
critical thinking, and analytical thinking (Brown et al., 2011). When integrated STEM education based 
on constructivist (Bransford, Brown and Cocking, 2000; Sanders, 2009) will be applied at schools or 
universities, it will pave the way for some radical changes according to the present education systems 
such as teaching methods (inquiry-based learning, project-based learning, problem-based learning, 
design-based learning, etc.) and assessment of materials, teacher training, class environment, etc. 
However, these kinds of radical changes are also responsible fortaken responsibility time, effort, support 
and financial commitment (Leung, 2020; Merrill, 2001; Sanders, 2009). Integrated STEM education 
contributes rediscovering present scientific knowledge based on learning science and mathematics, 
developing engineering and technological design processes, thinking about real world issues, enhancing 
analytical thinking, seeking solutions toward social, economic, and environmental issues, and contributing 
to the establishment of interdisciplinary relations of students at all grade levels. 

The most important feature that distinguishes this study from other studies is the determination 
of secondary school students’ tendencies towards science, technology, engineering and mathematics. 
After the STEM trends of the secondary school students are determined, program development experts 
will need to create a curriculum according to the determined trends. Teachers will need to determine 
alternative teaching strategies in order to achieve the goals determined according to the curriculum 
prepared. School administrations will need to provide the necessary equipment and materials to enable 
teachers and students to carry out activities based on research, project, collaboration, etc. The study 
is mainly focused on the tendency of the secondary school students. The other results of the research 
are focused on attracting the attention of school administrators, curriculum development experts and 
teachers. 
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STEM Education in Turkey 


In Turkey, science and mathematics classes are taught to the students at the secondary school level 
by using traditional educational approaches rather than integrated STEM education which are expressed 
together with science, technology, engineering and mathematics (Cevik, 2017; Yamak, Bulut and Dundar, 
2014). In this approach many science teachers just teach the students the area course without thinking 
about different disciplines, and they usually do not mention science applications toward engineering and 
technology at their own classes. The students have science, mathematics, computers, etc. classes but 
these classes are separately taught to the students by using traditional education which is focused on 
One discipline (e.g., science, mathematics). Therefore they may not synthesize instructed subjects, they 
might easily forget independent of taught knowledge, they may not be interested in STEM subjects, and 
they might not choose a STEM career, they can graduate from secondary and/or high schools with lower 
science and/or mathematics. Besides, the students are not taught engineering and technology classes in 
their own school curriculum and the national educational programs. 

The primary goal of the present study is defining the attitude and motivation of the secondary school 
students by thinking Turkish students’ demographic characteristics with a developed STEM attitude and 
motivation survey with the support of the Ministry of National Education. It is expected that this developed 
STEM survey in the research will fill the gap in the literature for thinking countries like us. 


Materials and Methods 


The present research covered two sections. The first section examined the pilot survey development 
procedures. The section consisted of conducting literature review, creating a large pool of the pilot 
survey items, taking expert opinions for items of the pilot survey, and performing factor analysis based 
on “exploratory factor analysis” and “confirmatory factor analysis”. The second section contained the 
application of the survey developed for attitude and motivation toward STEM. This section discussed the 
findings of the developed survey. 


The Pilot Survey Development Procedures 


The literature on STEM surveys (Faber et al., 2013; Kier et al., 2014; Tyler-Wood, Knezek and 
Christensen, 2010) measured the attitude and motivation of the students toward STEM disciplines was 
reviewed by using of ERIC, Google Scholar, and Science Direct. Volunteer 30 students were asked to 
write their own views on the integrated STEM education item by item. The similar expressions were 
considered based on students’ perspectives. Examined surveys and written views helped to determine 
items of the pilot survey and made a significant contribution of the pilot survey with 69 items. The pilot 
survey was sent to the five STEM specialists and six science, mathematics, and computer teachers 
working in STEM education for assessing the content validity. According to the expert recommendations, 
the pilot survey with 69 items on the five-point Likert scale was reviewed for each item. The items were 
scaled from strongly agree “5” to strongly disagree “1”. 


Participants 


The data of the pilot survey were collected from 1335 students in seven public secondary schools 
during the academic year of 2018-2019 in the third largest city (Izmir) of Turkey. The schools had not ever 
implemented integrated STEM education program. The pilot study was performed in two regions of Izmir 
in order to generalize the obtained findings of the research. The first region was metropolitan. The region 
covering two districts were randomly chosen by thinking of time and budget of the research. The second 
region was suburban. The region was close to the city center and was the author's workplace. All of the 
students were voluntary in the research. The students were anonymously asked to fill the survey and the 
surveys were coded randomly. 

The pilot survey of 192 students who filled the survey incorrectly and/or incompletely were not 
evaluated. Therefore the statistical analysis of the pilot survey was conducted on 1143 students. Six 
hundred and thirty-four of 1143 students were female and the rest of them were male. Table 1 indicates 
the demographic variables of the students. The 5" grade students were not taken part in the research. 
Because they went through the adaptation period for transition from primary to secondary school. 
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Table 1 
Demographic variables of the students 
Female % Male % Total % 
6!" grade 202 of .f 148 42.3 350 30.6 
7" grade 234 90.1 191 449 425 Aye 
8!" grade 198 53.8 170 46.2 368 32.2 


Students were approximately given ten minutes to fill out the pilot survey in their own class time. 
Before handing out the pilot survey, the explanatory information about the pilot survey were briefly 
presented to the students. 


Data Analysis 


The statistical analysis of the pilot survey was examined in two subtitles which are Explanatory 
Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA). EFA was performed by SPSS Statistics 
29 while CFA was conducted on AMOS 25 Graphics program. 


Explanatory Factor Analysis (EFA) of the Pilot Survey 


The pilot survey according to EFA consisted of 34 items. All items in the pilot survey were positive 
statements. Some statistical analysis data concerning the pilot survey were given as follows: Bartlett's 
test of sphericity was measured as 20429.593, df=561, p<.001, KMO (Kaiser-Meyer-Olkin) value was 
calculated as .91, total explained variance value was measured as 57.94% and Cronbach’s Alpha value 
was Calculated as .84. The obtained statistical data showed that the factor analysis for the pilot survey 
was appropriate (Hair et al., 2014). The pilot survey found four sub-factors. The sub-factors were named 
considering the content of the research. The first factor consisted of 7 items and was called “Science” (S). 
The second factor comprised 8 items and was called “Technology” (T). The third factor consisted of 10 
items and was called “Engineering” (E). The last factor comprised 9 items and was called “Mathematics” 
(M). Figure 1 indicates the relationship between the items and eigenvalues of the pilot survey. The factor 
loadings of the items (see in Appendix 1) are over .65 and the eigenvalues of sub-factors were above “1”. 
When the examined studies (Hair et al., 2014; Tabachnick and Fidell, 2012) in the literature were evaluated, 
it could be said that the values obtained from explanatory factor analysis are “high” and “acceptable”. 
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Figure 1. The relationship between the items and eigenvalues of the pilot survey 


www.ljcrsee.com 
108 


Gok, T. (2021). The development of the STEM (science, technology, engineering, and mathematics) attitude and motivation 
survey towards secondary school students, International Journal of Cognitive Research in Science, Engineering and Education 
(IJCRSEE), 105-119. 


Confirmatory Factor Analysis (CFA) of the Pilot Survey 


CFA was conducted to support EFA results of the pilot survey. CFA values are expected results 
between “acceptable fit” and “good fit”. After the statistical analyses were performed, the modification index 
values were observed between “acceptable fit” and “good fit’. Table 2 illustrates the CFA measurement 
values. 


Table 2 
The fit indexes of CFA 
Reference Value” 
Fit Indexes Measurement Acceptable/Reasonable Fit Good Fit 
CMIN/df 2.63 fap x fdf = 3 
NFI 93 .90 < NFI OS <oNFI 
TLI(NNEI) 95 .90 < NNFI .95 < NNFI 
IF | 95 SO = iF I 95 <= 1FT 
CFI 95 95: = CFI re A dew OF os 
RMSEA 03 RMSEA <= .08 RMSEA <= .05 
GF 93 .85 < GFI .90 < GFI 
AGFI 92 .85 < AGFI .90 < AGFI 
RMR 04 0< RMR < .08 0< RMR <= .05 
SRMR 02 0< SRMR < .08 0< SRMR = .05 


Note: CMIN/df, Chi-Square Goodness of Fit for AMOS; NFI, Normed Fit Index; NNFI, Non-Normed Fit Index or TLI, Tucker- 
Lewis Index; IFI, Incremental Fit Index; CFl, Comparative of Fit Index; RMSEA, Root Mean Square Error Approximation; GFI, 
Goodness of Fit Index; AGFI, Adjusted Goodness of Fit Index; RMR, Root Mean Square Residual; SRMR, Standardized Root 
Mean Square Residual; * Reference Value: (Karagoz, 2016; Schermelleh-Engel, Moosbrugger, and Muller, 2003) 


The results obtained trom CFA according to examined studies in the literature (Byrne, 2013; Hu 
and Bentler, 1999; Karagoz, 2016; Schermelleh-Engel, Moosbrugger and Muller, 2003) indicated that the 
calculated measurement values are “valid”, and “reliable”. Figure 2 shows the factor loading values of the 
pilot survey according to CFA. 
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Figure 2. The factor loading values of the pilot survey according to CFA 


Results 


The Application of the Developed Survey 
A new field study was conducted to evaluate the results of the developed survey. The second 


field study was performed by different students except the schools visited for the pilot survey. In this 
study, the following research questions were investigated: 1) Is there a significant difference between the 
grade levels of the students toward the STEM attitude and motivation surveys? 2) Is there a significant 
difference between the female students instructed in metropolitan and suburban toward STEM attitude 
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and motivation surveys? 3) Is there a significant difference between the male students instructed in 
metropolitan and suburban toward STEM attitude and motivation surveys? 

The data of the developed survey were collected from 1577 students in seven different secondary 
schools during the academic year of 2018-2019 in the third largest city (Izmir) of Turkey. Three hundred 
and forty-seven of 15/77 student surveys were not evaluated because of missing data. One thousand 
two hundred and thirty students filled out the survey in full. Six hundred and eighty-three students live 
in the metropolitan and the others live in the suburbs. Six hundred and fourteen of 1230 students were 
female and the other students were male. Table 3 indicates the demographic characteristics distributions 
according to region, gender and grade level of the students. In this process for the developed survey, 5" 
grade students’ data were used to compare and discuss the results of the students at all grade levels. 


Table 3 
The demographic characteristics of the students 


Female Male Total 
MM % S % MM % S % M-S % 
5'h grade 101 30.06 56 20.14 93 2680 49 1822 299 24.31 
6' grade 82 2440 76 27.34 85 2450 6/ 2490 310 25.20 
7h grade 72 2143 81 2914 75 31.61 72 26.77 300 24.39 
8'" grade 810 2411 4 650 23.38 940 27.09) 81S 30.11 321 26.10 


Note: M: Metropolitan; S: Suburban 


Table 4 demonstrates the independent samples t-test results according to the students’ grade 
levels. It was realized that there was not a significant difference between the 5" grade students’ science, 
technology, engineering and total STEM values except their own mathematics value. Also there was not 
a significant difference between the 6" grade students’ and between the 8" grade students’ science, 
technology, engineering, mathematics and total STEM values. It was found that there was a significant 
difference between the 7" grade students’ all values. 


Table 4 
The comparative results of the survey according to the grade levels 


S T E M STEM 


Bh grade toon 88 p>.05 —traon=.22 p>.05 — taon= 54 p>.05 — trao= 2.50 p<.05  traon= 1.51 p>.05 
Bthgrade —traog= 1.91 p>.05 — taog=.27 p>.05 —teangj=.19 p>.05 —tygoy= 1.44 p>.05 — traog= .07 p>.05 
Thgrade — tiaog)= 4.61 p<.05 — traog= 3.22 p<.05 — troog)= 3.41 p<.05 — traog= 5.37 p<.05 — trrag= 5.67 p<.05 
Bthgrade —tiaig= 1.83 p>.05  taig= 1.66 p>.05  tisig= 1.57 p>.05 — taig= 01 p>.05 tig = 1.58 p>.05 


Table 5 presents the descriptive statistics of students’ attitude and motivation towards STEM in 
metropolitan and suburban areas. Table 6 and Table 7 also show the mean of students’ attitude and 
motivation toward STEM according to the grade level, gender and region. The answers of the students 
studied in metropolitan were in the range of 34 and 170 points while the answers of the students studied 
in sub-urban were in the range of 45 and 170 points. 
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Table 5 
The mean of the students’ surveys according to gender and region 
Female Male Total 
R N AM SD N AM SD N AM SD 
S M 336 625.66 6.55 347 24.54 6.68 683 25.09 6.63 
5 2/8 26.47 9.62 269 26.01 6.15 S47 26.25 5.89 
- M 336 627.68 743 347 = 30.71 6.6/ 683 29.22 7.21 
2 2/8 28.42 6.58 269 31.39 6.7/7 S47 2988 86.83 
c M 336 3043 1053 34/7 35.58 10.26 683 33.04 10.70 
2 2/8 3147 95/ 269 37.23 956 S47 34.30 9.98 
M M 336 §©632.92 981 347 3095 1010 683 31.92 9.99 
5 2/8 =33.27 985 269 3090 1013 S547 3210 10.05 
STEM M 336 116.69 26.70 34/7 121.78 2458 683 119.28 25.75 
5 2/8 119.63 23.03 269 12552 23.63 S47 12253 23.50 


Note: R: Region; AM: Arithmetic Mean; SD: standard deviation 


The results of the students instructed in metropolitan and suburban were compared with 
independent samples t-test. The statistical analysis according to the sub-factors of the developed survey 
were calculated as b zp) =3.18 p<.09 for “Science”, t.,.=1.63 p>.05 for “Technology’, t.,...=2.11 p<.00 for 
“Engineering”, t.,...)=- 34 p>.05 for “Mathematics”, and finally tone =2-28 P<.00 for “STEM” respectively. 
The results of the female and male students instructed in metropolitan and suburban were compared 
with independent samples t-test. The statistical analysis results of the female students according to the 
sub-factors of the developed survey were calculated as tei 1-61 p>.00 for “Science’, tei 1-29 p>.00 for 
“Technology”, aa! .21 p>.05 for “Engineering”, te 7 43 p>.05 for “Mathematics”, and finally te ra, 44 
p>.05 for “STEM” respectively. The statistical analysis results of the male students ‘according to the sub- 
factors of the developed survey were calculated as t =2.81 p<.05 for “Science”, t,, yn -29 p>.05 for 
“Technology”, t 614) =2.03 p<.05 for “Engineering”, t ne "06 p>. 05 for “Mathematics”, and finally tera 1-90 
p>.05 for “STEM” respectively. 

After the descriptive statistics as shown in Table 6 and Table 7 were determined, the comparative 
analysis was calculated according to the grade levels and gender of the students in metropolitan and 
suburban areas. It was calculated that there was not a significant difference between the male students’ 
science, technology, engineering, mathematics and total STEM values and between the female students’ 
science, technology and total STEM values for 5"-8" grade levels. 


Table 6 
The means of the students’ survey according to the grade level and gender in metropolitan 
5th grade 6th grade 7 grade 8th grade 
F M AM F M AM F M AM F M AM 
S 2859 2717 27.91 25.90 23.02 2444 2385 22.76 23.29 23.37 24.72 24.10 
T 3092 3254 31.70 28.33 31.07 2972 2538 28.71 27.07 25.04 30.19 27.81 
E 3352 36.15 34.78 32.09 3467 3340 2747 3481 31.22 2752 3644 32.31 
M 37.01 35.73 3640 35.39 30.41 32.86 2868 2695 2780 29.09 29.90 29.53 
STEM 130.05 131.59 130.79 121.71 119.18 120.42 105.38 113.23 109.04 105.01 121.26 113.74 
Table 7 
The means of the students’ survey according to the grade level and gender in suburban 
of grade 6th grade 7 grade 8t" grade 
F M AM a M AM E M AM F M AM 
S 2746 27.16 27.32 2555 26.00 27.76 2657 2692 26.73 2655 2453 25.43 
T 30.63 3255 31.52 27.54 31.76 2952 2822 3142 29.73 2782 30.35 29.22 
E 31.86 36.59 3407 3017 3754 3362 3206 38.75 35.21 31.92 36.00 34.18 
M 36.68 3035 33.72 31.36 31.31 31.34 33.91 3446 3417 31.75 27.72 29.51 
STEM 126.63 126.65 126.64 114.62 126.61 120.24 120.77 131.54 125.84 118.05 118.59 118.35 


Note: F: Female; M: Male; AM: Arithmetic Mean 
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Discussions 


In this section, the results obtained from the statistical analysis were generally discussed. Figure 3 
presents that the attitude and motivation of the students instructed in metropolitan and suburban towards 
STEM broadly decreased from 5" grade level to 8" grade level. The attitude and motivation of the students 
studying in the metropolitan area diminished by 9 percent while the attitude and motivation of the students 
studying in the suburbs decreased by 6 percent. 
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Figure 3. The students’ STEM mean value according to the grade level and region 


According to the first research question, there was not a meaningful difference between the 
students’ values instructed in the 5" grade level, the 6" grade level and 8" grade level except the 7" grade 
level toward STEM attitude and motivation survey. 

The 5" grade and the 6" grade students in metropolitan and suburban might have spent more 
time for the orientation period from primary school to the secondary school. The students in the 8" grade 
level were prepared for high school exams in order to enroll in state, private, science, and vocational high 
schools. These students might not have adequately shown the interest in STEM disciplines because of 
exam stress and anxiety. The students in the 7" grade level might have been more interested in STEM 
disciplines because they quickly completed the orientation period and they did not have any high school 
exam stress and anxiety. The 7" grade students in the suburbs were more curious and enthusiastic toward 
STEM disciplines than the students in the metropolitan. They followed the developments and innovations 
in science, technology and engineering fields. Shortly, the students in suburban areas focused on less 
cultural activities, more on STEM disciplines. 

The decreases in the graph show that the STEM viewpoints of the students in metropolitan and 
suburban negatively influenced while going from the 5" grade level to the 8'" grade level. The decline on 
the attitude and motivation of the students toward STEM could be explained in terms of the students, 
the teachers and the schools as follows: a) Many students may not be interested in STEM, they may 
not want to study science and mathematics classes, they may have been guided to different disciplines 
(e.g., political sciences, visual art, social science, sports science etc.) in their career choice except STEM 
disciplines. b) The teachers may not have received any education on STEM, so the students may not have 
been adequately informed and guided about STEM, they may have used traditional educational methods 
and approaches instead of integrated STEM education based on project-based learning, problem-based 
learning, inquiry-based learning, cooperative learning etc. Science teachers generally performed in 
their own lessons in the classroom environment instead of the laboratory environment. Therefore many 
students may have decreased interest and curiosity towards STEM. c) The necessary and sufficient 
physical conditions (e.g., budget, laboratory tools, class, computers, internet, etc.) of the schools may not 
be convenient for integrated STEM education in terms of the secondary schools. 

Figure 4a and Figure 4b indicate the total STEM value of the female and male students instructed 
in metropolitan and suburban. 
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Figure 4a. Female students’ STEM mean value Figure 4b. Male students’ STEM mean value 
according to the grade level and region according to the grade level and region 


The STEM value of the female students instructed in metropolitan and suburban decreased from the 
5" grade level to the 8" grade level. The decline values were calculated as 16 percent for metropolitan and 
6 percent for suburban. According to the second research question, there was not a meaningful difference 
between the female students’ values instructed in metropolitan and suburban toward STEM attitude and 
motivation surveys. But, total STEM values of the female students in the metropolitan generally decreased 
from the 5" grade level to the 8" grade level. Total STEM values of the female students in suburban areas 
varied from the 5" grade level to the 8" grade level. The STEM attitude and motivation values of the 
female students decreased at the 6" grade level. The values of the female students increased at the 7" 
grade level and negatively showed small change in the 8" grade level. The female students in suburban 
areas were more interested in science, technology, engineering, and mathematics disciplines according 
to the female students instructed in metropolitan areas. 

The STEM value of the male students instructed in metropolitan and suburban also decreased from 
the 5" grade level to the 8" grade level. The decline values were found as 7 percent for metropolitan and 
5 percent for suburban respectively. According to the third research question, there was not a meaningful 
difference between the male students instructed in metropolitan and suburban toward STEM attitude and 
motivation surveys. But, total STEM values of the male students in metropolitan generally decreased from 
the 5" grade level to the 8" grade level. Total STEM values of male students instructed in metropolitan 
schools began to rise from the 7" grade level to the 8" grade level. Total STEM values of the male students 
increased from the 5" grade level to the 7" grade level and then the values of the male students decreased 
at the 8" grade level. It could be said that the male students as in the female students in suburban might 
have been more willing and interested in science, technology, engineering, and mathematics disciplines 
according to the male students instructed in metropolitan. 

Broadly, the total STEM values of the male and female students instructed in metropolitan were 
lower than the total STEM values of the male and female students instructed in suburban. The attitude 
and motivation values toward STEM of the female students in metropolitan according to grade levels 
were lower than the STEM values of the male students. The STEM value of female students instructed 
in metropolitan areas declined from 131 points to 105 points. It could be said that as the grade levels 
of the students in suburban and metropolitan increases, the students’ attitude and motivation values 
toward STEM decreases. These decline values might be attributed to following points: The female and 
male students in metropolitan may not be interested in STEM, they might have gotten around to cultural 
ac-tivities more time instead of learning science and mathematics classes, they might have difficulties in 
learning science and mathematics. 

Figure 5a and Figure 6a indicate the science mean values of the female and male students in 
metropolitan and suburban areas. Science values of the male students in metropolitan and suburban 
changed at the same rate (6%). Science values of the female students in suburban areas did not 
considerably change. But, the science value of the female students in metropolitan areas considerably 
decreased from the 5" grade level to the 8" grade level. The decrease was approximately 17 percent. 
These results indicated that many of the female students may have problems visualizing abstract concepts 
and understanding fundamental concepts and principles about science. The science values of the female 
students may also have been affected from the following factors: a) the cultural level of the society may 
be an important factor in the choice of profession of the female students. b) the female students might 
worry about the future, c) psychological and sociological support may not be provided to the female 
students during their career choices, d) the female students may see themselves insufficient for science 
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and mathematics classes, e) the female students might not show any interest in science and mathematics 
classes. 

Figure 5b and Figure 6b present the technology mean values of the female and male students in 
metropolitan and suburban. The technology value of the female students dramatically decreased from 
the 5" grade level to the 8" grade level. This decline was roughly 15 percent. The technology values of 
the other students in metropolitan and suburban areas negatively changed at the same rate. The rate of 
change was about 8 percent. Concern with technology of the female students instructed in metropolitan 
was lower than other students. As understood from the graphics, the female students were not interested 
in technology, the female students may have directed their interests and curiosity to different disciplines. 
Besides, the students may not generally have technology design class and computer class in their schools, 
they might not have enough computers and internet in their school, they may not have technology and 
design teachers in their schools. 

Figure 5c and Figure 6c illustrate the engineering mean values of the female and male students in 
metropolitan and suburban. The engineering values of the male students in metropolitan and the female 
students in suburban did not change. The engineering value of the male students in suburban schools 
slightly changed from the 5" grade level to the 8" grade level with a 2 percent decline. The engineering 
value of the female student declined from the 5" grade level to the 8" grade level by 12 percent. The 
engineering values presented show that many students except the female students in metropolitan areas 
may take interest in engineering. Many students want to pursue their own careers on in engineering 
education. Most students may enjoy repairing electronic and mechanical devices. They like to see 
engineering applications in their daily lives. Many students also prefer the engineering profession to lead 
a more comfortable life and earn a lot of money. 

Figure 5d and Figure 6d present the mathematics mean values of the female and male students in 
metropolitan and suburban. The mathematics values of all students decreased. The decline of mathematics 
values of the female (18%) and male (13%) students trained in metropolitan was higher than the decrease 
of mathematics values of the female (11%) and male (5%) students trained in suburban. The findings 
indicated that many students do not want to choose a career in this field. Many students might not like 
to learn mathematics, they might have difficulty performing and understanding mathematical operations, 
teachers may not have experience in subject knowledge and pedagogical knowledge on the students’ 
attitudes. 
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Conclusions 


The difference of this study from other conducted studies that are adaptation of the STEM 
questionnaire or that focuses on the development and approval procedures of anew STEM questionnaire 
(Barlow et al., 2020; Faber et al., 2013; Guzey, Harwell and Moore, 2014; Paul, Maltese and Valdivia, 
2020; Unfried et al., 2015), focusing on developing the “STEM attitude and motivation survey” in 
secondary school and discussing the collected data in terms of grade and region with the help of second 
field research. Statistical analysis results of the attitude and motivation survey toward STEM indicated 
that the reliability and validity of the developed survey was reliable and helpful to identify the students’ 
attitude and motivation for science, technology, engineering, and mathematics fields. The research was 
conducted to the secondary school students instructed in metropolitan and suburban. The results of 
the developed survey were presented that the total values of the students instructed in suburban were 
higher than the total values of the students instructed in metropolitan. The attitude and motivation of both 
the female students and the male students in suburban and metropolitan toward STEM decreased from 
the 5" grade level to 8" grade level. This decline in suburban students was relatively less according to 
metropolitan students. The science, technology, and engineering values of the female stu-dents instructed 
in metropolitan were comparatively lower than the male students’ values. The similar studies (Blatt et al., 
2020; Kurban and Cabrera, 2020; Whitcomb et al., 2020) in the STEM field support the results of the 
research. The matematics values of the female and male students remained at the same level from 
the 5" grade level to the 8" grade level and the mathematics values of the students declined as in 
other sub-factors. The science and mathematics values of the female students instructed in suburban 
schools were slightly higher than the male students’ values. The technology and engineering values of 
the male students in the suburbs was higher than the female students’ values. Especially the attitude and 
motivation for engineering field of the male students were higher than the other fields. 


Recommendations 
some recommendations based on the results of the research could be listed as follows: Integrated 


STEM education might be applied at all grade levels in the course of time. A sustainable education policy 
should be followed to discuss the results of the integrated STEM education. Field teachers might be 
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given training about integrated STEM education. The importance of integrated STEM education may 
be explained to policy makers and administrators. The importance of integrated STEM education might 
be explained to the society. The importance of technology and engineering could be explained to the 
students. Field teachers may encourage students to do hands-on activities in a laboratory environment. 
science, technology design and mathematics teachers in the schools might work in cooperation by using 
integrated teaching and learning approaches. School administrators may establish a strong interaction 
and communication between school and faculty of engineering and natural sciences for the development 
of the students. The teachers might integrate their own classes with technology and engineering, explain 
relationships between technology and engineering with the help of richer and deeper integrated STEM 
curriculum programs. Researchers could examine the effects of integrated STEM education on students’ 
academic achievement with the help of the experimental studies. There are not enough studies about 
students’ achievement in the literature. More studies and data in order to evaluate and interpret the effects 
of the integrated STEM education are needed in the literature. 


Limitations 


The limitations of the research are given as follows: The pilot survey and the developed survey can 
be applied to many more secondary school students in different cities of Turkey. The pilot survey was not 
applied to the 5"" grade students. Because they experienced the orientation process. The relationships 
between academic achievement in science and mathematics and attitude and motivation towards STEM 
surveys of the secondary school students can be examined. The effects of parents’ education level on 
students’ perspective on STEM fields should be investigated. 


Acknowledgements 


First of all, | would like to thank Izmir Directorate of National Education for supporting the research. 
Later, | would like to thank the secondary school administrators and teachers who supported the 
implementation of the questionnaire. Finally, | would like to thank the students who voluntarily participated 
in the survey. 


Conflict of interests 
The author declares no conflict of interest. 


References 


Abe, E. N., & Chikoko, V. (2020). Exploring the factors that influence the career decision of STEM students at a university in 
south Africa. International Journal of STEM Education, 7, 60, 1-14. https://doi.org/10.1186/s40594-020-00256-x 

Barlow, A., Brown, S., Lutz, B., Pitterson, N., Hunsu, N., & Adesope, O. (2020). Development of the student course cognitive 
engagement instrument (SCCEI) for college engineering courses. International Journal of STEM Education, 7, 22, 
1-20. https://doi.org/10.1186/s40594-020-00220-9 

Blatt, L., Schunn, C. D., Votruba-Drzal, E., & Rottman, B. M. (2020). Variation in which key motivational and academic 
resources relate to academic performance disparities across introductory college courses. International Journal of 
STEM Education, 7, 58, 1-25. https://doi.org/10.1186/s40594-020-00253-0 

Bransford, J. D., Brown, A. L., & Cocking, R. R. (2000). How people learn: Brain, mind, experience, and school. Washington, 
DC: National Academy Press. Retrieved from http://www.csun.edu/~SB4310/How%20People%20Learn.pdf 

Breiner, J. M., Harkness, S. S., Johnson, C. C., & Koehler, C. M. (2012). What is STEM? A discussion about conceptions of 
STEM in education and partnerships. Schoo! Science and Mathematics, 112(1), 3-11. https://doi.org/10.1111/}.1949- 
8594.2011.00109.x 

Brown, R., Brown, J., Reardon, K., & Merrill, C. (2011). Understanding STEM: current perceptions. Technology and 
Engineering Teacher, 70(6), 5-9. Retrieved from http:/www.stemteacherlearning.com/uploads/topics/stem-curricula/ 
Understanding%20STEM.pdf 

Bybee, R. W. (2010a). What is STEM education? Science, 329, 996. https://doi.org/10.1126/science. 1194998 

Bybee, R. W. (2010b). Advancing STEM education: A 2020 vision. Technology and engineering teacher, 70(1), 30-35. Retrieved 
from https://search.proquest.com/openview/75bbe8b1 3bf3f54ebd755333ffd8621e/1 ?pq-origsite=gscholar&cbl=34845 

Bybee, R. W. (2011). Scientific and engineering practices in K-12 classrooms: Understanding a framework for K-12 science 
education. Science and Children, 49(4), 10-16. Retrieved from https:/www.nmu.edu/seaborg/sites/DrupalSeaborg/ 
files/UserFiles/Files/NGSS/Scientific_and_Engineering_Practices_in_K-12_Classrooms_by_Rodger_Bybee.pdf 

Byrne, B. M. (2013). Structural equation modeling with AMOS: Basic concepts, applications, and programming (2° ed.). New 
York: Routledge. 

Cevik, M. (2017). Astudy of STEM Awareness Scale development for high school teachers Ortaogretim ogretmenlerine yonelik 
FeTeMM Farkindalik Olgegi (FFO) gelistirme calismasi. Journal of Human Sciences, 14(3), 2436-2452. Retrieved from 


www.ijcrsee.com 
117 


Gok, T. (2021). The development of the STEM (science, technology, engineering, and mathematics) attitude and motivation 
survey towards secondary school students, International Journal of Cognitive Research in Science, Engineering and Education 
(ISCRSEE), 9(1), 105-119. 


https://www.j-humansciences.com/ojs/index.php/IJHS/article/view/4673 

Christensen, R., Knezek, G., & Tyler-Wood, T. (2015). Alignment of hands-on STEM engagement activities with positive STEM 
dispositions in secondary school students. Journal of Science Education and Technology, 24(6), 898-909. https://doi. 
org/10.1007/s10956-015-9572-6 

Craig, C. J., Verma, R., Stokes, R., Evans, P., & Abrol, B. (2018). The influence of parents on undergraduate and graduate 
students’ entering the STEM disciplines and STEM careers. International journal of science education, 40(6), 621-643. 
https://doi.org/10.1080/09500693.2018.1431853 

Faber, M., Unfried, A., Wiebe, E. N., Corn, J., Townsend, L. W., & Collins, T. L. (2013). Student attitudes toward STEM: The 
development of upper elementary school and middle/high school student surveys. In the Proceedings of the 120" 
American Society of Engineering Education Conference. 

Guzey, S. S., Harwell, M., & Moore, T. (2014). Development of an instrument to assess attitudes toward science, technology, 
engineering, and mathematics (STEM). School Science and Mathematics, 114(6), 271-279. https://doi.org/10.1111/ 
ssm.12077 

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis William C. Black. 7" ed. Harlow: 
Pearson Education Limited. 

Hanson, S. L., & Krywult-Albanska, M. (2020). Gender and access to STEM education and occupations in a cross-national 
context with a focus on Poland. /nternational Journal of Science Education, 42(6), 882-905. https://doi.org/10.1080/0 
9500693.2020.1737341 

Hasanah, U. (2020). Key Definitions of STEM Education: Literature Review. Interdisciplinary Journal of Environmental and 
Science Education, 16(3), e2217. 1-7. https://doi.org/10.29333/ijese/8336 

Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria 
versus new alternatives. Structural equation modeling: a multidisciplinary journal, 6(1), 1-55. https://doi. 
org/10.1080/10705519909540118 

Karagoz, Y. (2016). SPSS and AMOS 23 Applied Statistical Analyzes. Ankara: Nobel Academic Publishing., Turkey. 

Kelley, T. R., & Knowles, J. G. (2016). A conceptual framework for integrated STEM education. International Journal of STEM 
Education, 3(1), 11. https://doi.org/10.1186/s40594-016-0046-z 

Kier, M. W., Blanchard, M. R., Osborne, J. W., & Albert, J. L. (2014). The development of the STEM career interest survey 
(STEM-CIS). Research in Science Education, 44(3), 461-481. https://doi.org/10.1007/s11165-013-9389-3 

Kurban, E. R., & Cabrera, A. F. (2020). Building readiness and intention towards STEM fields of study: using HSLS: 09 and 
SEM to examine this complex process among high school students. The Journal of Higher Education, 91(4), 620-650. 
https://doi.org/10.1080/00221546.2019.1681348 

Leung, A. (2020). Boundary crossing pedagogy in STEM education. International Journal of STEM Education, 7, 15, 1-11. 
https://doi.org/10.1186/s40594-020-00212-9 

Li, Y., Wang, K., Xiao, Y., & Froyd, J. E. (2020). Research and trends in STEM education: a systematic review of journal 
publications. International Journal of STEM Education, 7, 11.https://doi.org/10.1186/s40594-020-00207-6 

Luo, T., Wang, J., Liu, X., & Zhou, J. (2019). Development and application of a scale to measure students’ STEM continuing 
motivation. International Journal of Science Education, 41(14), 1885-1904. https://doi.org/10.1080/09500693.2019.1 
647472 

Maltese, A. V., & Tai, R. H. (2011). Pipeline persistence: Examining the association of educational experiences with earned 
degrees in STEM among US students. Science education, 95(5), 877-907. https://doi.org/10.1002/sce.20441 

Margot, K. C., & Kettler, T. (2019). Teachers’ perceptions of STEM integration and education: A systematic literature review. 
International Journal of STEM Education. 6:2 https://doi.org/10.1186/s40594-018-0151-2 

Merrill, C. (2001). Integrated technology, mathematics, and science education: A-quasi experiment. Journal of Industrial 
Teacher Education, 38(3), 45-61. Retrieved from https://scholar.lib.vt.edu/ejournals/JITE/v38n3/merrill.htm| 

Paul, K. M., Maltese, A. V., & Valdivia, D. S. (2020). Development and validation of the role identity surveys in engineering 
(RIS-E) and STEM (RIS-STEM) for elementary students. International Journal of STEM Education, 7, 45, 1-17. https:// 
doi.org/10.1186/s40594-020-00243-2 

Sadler, P. M., Sonnert, G., Hazari, Z., & Tai, R. (2012). Stability and volatility of STEM career interest in high school: A gender 
study. Science education, 96(3), 411-427. https://doi.org/10.1002/sce.21007 

sanders, M. (2009). Integrative STEM education: primer. The Technology Teacher, 68(4), 20-26. 

Schermelleh-Engel, K., Moosbrugger, H., & Muller, H. (2003). Evaluating the fit of structural equation models: Tests of significance 
and descriptive goodness-of-fit measures. Methods of psychological research online, 8(2), 23-74. Retrieved from http:// 
citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.509.4258&rep=rep 1 &type=pdf 

So, W. W. M., Zhan, Y., Chow, S. C. F., & Leung, C. F. (2018). Analysis of STEM activities in primary students’ science projects 
in an informal learning environment. International Journal of Science and Mathematics Education, 16, 1003-1023. 
https://doi.org/10.1007/s10763-01 7-9828-0 

Tabachnick, B.G., & Fidell, L. S. (2012), Using muttvanate statistics (6 eq.) New York: NY:Pearson Education Inc. 

Tyler-Wood, T., Knezek, G., & Christensen, R. (2010). Instruments for assessing interest in STEM content and careers. Journal 
of Technology and Teacher Education, 18(2), 345-368. Retrieved from https://www.learntechlib.org/p/32311/ 

Unfried, A., Faber, M., Stanhope, D. S., & Wiebe, E. (2015). The Development and Validation of a Measure of Student Attitudes 
Toward Science, Technology, Engineering, and Math (S-STEM). Journal of Psychoeducational Assessment, 33(7), 
622-639. https://doi.org/10.1177/0734282915571160 

Whitcomb, K. M., Kalender, Z. Y., Nokes-Malach, T. J., Schunn, C. D., & Singh, C. (2020). A mismatch between self-efficacy 
and performance: Undergraduate women in engineering tend to have lower self-efficacy despite earning higher grades 
than men. arXiv preprint arXiv:2003.06006. Retrieved from https://arxiv.org/abs/2003.06006 

Yamak, H., Bulut, N., & Dundar, S. (2014). The impact of STEM activities on 5" grade students’ scientific process skills and 
their attitudes towards science. Gazi Egitim Fakultesi Dergisi, 34(2), 249-265. 


www.ljcrsee.com 
118 


Gok, T. (2021). The development of the STEM (science, technology, engineering, and mathematics) attitude and motivation 
survey towards secondary school students, International Journal of Cognitive Research in Science, Engineering and Education 
(IJCRSEE), 105-119. 


Appendix 1 
Items and factor loading of the sub-factors of the survey for the secondary school students 
Item Numbers ltems S T E M 
1 sci4 | like to attend more science classes Ol 
2 Sc3 | like science classes 16 
§ 3 §c13 | like to participate in project studies on science hs 
4 SC | like to make @ career in science field i3 
5 §c15 | can do an advanced study in science field M3 
6 $05 | like to solve problems related to science class ae, 
7 $c4 | work hard for science classes 0 
§ TC9 lf | choose a career in technology field, | may be more 99 
successful 
4 TC13 | like to attend more technology classes tT 
10 TC12 | can do an advanced study in technology field tT 
11 TC14 | like to participate in project studies on technology field A3 
T 12 TC1 | like to make @ career in technology field f2 
13 TC3 lf | choose a career in technology field, | may eam 7) 
much more money 
14 TCH lf | choose a career in technology field, | may make my 79 
family happier 
15 TC10 lf | choose @ career in technology field, | may work for 7 
nappiness of people : 
16 EG/ | like to participate in projects on engineering field 83 
17 EGS | like to attend more engineering classes 2 
18 EGS | try to follow new developments in engineering field 0 
19 EG10 | can do an advanced study in engineering field 18 
E 20 EG1/ | like reading scientific books and journals on engi- 7h 
neering field - 
21 EG18 _| like to watch documentary about engineering field td 
22 EG | like to make @ career in engineering field 3 
23 EGS | like to learn operation principles of machines and 71 
electronic devices 
24 EG4 | can develop new and creative ideas in engineering 68 
field 
29 EG5 | like to repair machines and electronic devices 68 
26 MT3 | like mathematics classes 69 
2? MT5 | like to solve mathematics problems 4 
28 MT9 | can do an advanced study in mathematics field Bi 
29 MTd | like to attend more mathematics classes Ol 
M 30 MTf | like to participate in projects on mathematics field 19 
31 MT1 | like to make a career in mathematics field AS 
32 M12 | can take high scores in mathematic classes 16 
33 MT4 | work hard for mathematics classes 16 
34 MT16~—s| like reading scientific books and journals on mathe- 1 
matics field 
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Impact of a One-Off Demonstration on the Use of ICT in the Teaching of 
Andragogy Students on Their Change of Attitude Towards the Use of ICT 
in Education 
Martin Kursch" 

‘Charles University, Prague, Czech Republic; e-mail: martin.kursch@pedf.cuni.cz 


Abstract: The research study deals with the issue of attitudes towards the use of ICT in the education of andragogy 
students. As a method of research, we chose a three-year experiment. The study first surveyed 224 students in andragogical 
fields — future educators - in order to discover input factors like identifying their relationship to ICT, skills, experience in the 
field of ICT and frequency of the use of ICT at work. The study further examines four separate variables, representing three 
dimensions of attitudes (cognitive, conative and emotional) towards the use of ICT in education — the conviction to use ICT in 
their teaching, the opinion on the impact of the use of ICT on the understanding of curriculum, the opinion on the impact of the 
use of ICT in teaching and education itself and the tendency to act to recommend the use of ICT in teaching to their colleagues. 
In the university teaching of students itself, using the didactic method of AIDA on a mathematical problem, the experimental 
group is the subject of a demonstration of the use of ICT in empirical verification of the results of the task, as opposed to a control 
group that does not use ICT in teaching. Specifically, the representation of results in MS Excel and the empirical verification 
of results in a Python-created program are used. The research aims to determine the impact of the demonstration of a one-off 
use of ICT in teaching on the change of dimensions of attitude towards the use of ICT in education represented by separated 
variables. Their rate is measured by a 10-point bipolar scale. The results show p value (p<0.05), which provides evidence that a 
one-off demonstration of the use of ICT in the teaching of andragogy students is a factor that statistically significantly influences 
these dimensions of attitude towards the use of ICT in education and thus its overall change, regardless of the gender of the 
students. The three-year research study confirmed these results in an aggregated experimental group of 112 respondents who 
were compared with the same aggregated control group. 

Keywords: ICT in education, Python, AIDA method, attitudes towards the use of ICT in education. 


Introduction 


The issue of the use of ICT in education is extensive. Due to the rapid expansion of the use of ICT 
in all areas of education in recent decades, it has not been enough to form a uniform methodology for 
the teaching of ICT (Takada et al., 2020). The concept of the use of ICT in teaching can be understood in 
two ways: ICT as a teaching support tool for mediation of information (e.g., video usage, data projector, 
mobile devices, internet for searching, etc.) or as a tool for the understanding of curriculum or tool for 
solving the problem (modelling in applications, creative creation of multimedia content, use of robots, 
virtualization of reality, simulation, etc.). Teachers, adult educators, lecturers, education advisers and 
education managers (henceforward we generally use only the term “educators” for all roles) are subject 
to ever-higher requirements in the field of ICT management and its use in teaching. There are also 
many concepts of digital competencies, such as DigComp (European Digital Competence Framework 
2.0) (Vuorikari et al., 2016). This model works with eight levels of competence from beginner to expert. 
The aim is for future standardisation of jobs; for example, an employer will be able to say that he requires 
a certain level of competence. Technological Pedagogical Content Knowledge (TPCK) is one of the 
general frameworks of the basic knowledge needed to perform the teaching profession. Koehler et al. 
(2013) seek to apply the TPCK model in the preparation of future teachers. They verify their approach 
at the Learning Technology Through Design course. In it, students of different specializations learn 
to prepare (create) ICT-based tutorials together. They propose their own course focused on specific 
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content, a project implementing a specific teaching activity, a website, etc. Students work here in teams 
in which the roles of all three specializations (TPC) are represented. Together, under the guidance of 
lecturers, they seek mutual intersections to include all possible views in the resulting work (Brdicka, 2009). 

It is clear that mere knowledge of ICT is not a sufficient condition for its active use in teaching. If we 
consider the evolution of teaching methods in the context of the transition from behaviourism, cognitivism 
and constructivism to connectivism (Siemens, 2005), we come to the paradigm of teaching methods as 
a comprehensive approach using various sources. And at this point, it is necessary to distinguish the 
instructional and constructive approach to teaching methods. It is the constructive methods that are more 
Closely linked to the use of ICT as a tool for understanding of curriculum or solving problems. Brdicka 
(2004) aptly points out “that the most important thing for teachers Is to understand what is the most effective 
way of deploying technologies using different teaching procedures. Since it is easier for the instructive, 
the emphasis must nowadays be mainly on constructive procedures. Only a teacher successfully through 
the stage of empathy can reach a successful end to the process, I.e., to the innovation itself. At this last 
stage, it is his task to customize the outline and change his working methods for real.” Managing ICT 
and integrating it into teaching therefore requires certain mastery, knowledge and skills. However, the 
concept of Education 4.0 in the concept of Kursch and Veteska points to other factors that should be 
considered to make the use of ICT in education innate by future educators (Kursch and Veteska, 2019). 
According to them, the factors of initiating their outburst, enthusiasm for the cause and engagement 
are also important. As part of the university training of andragogy students, these factors could be a 
trigger for further action in this area. Many studies are looking at the positive effects of the use of ICT 
in teaching, both for students and teachers (Hardman, 2019; Mlambo, Rambe and Schlebusch, 2020; 
Coklar, 2013; Cok, 2016; Genlott and Gronlund, 2016); Willis et al., 2019; Hammond, 2017, Garzon et 
al., 2020); Eger et al., 2020; Chang, Tu and Hajiyev, 2019; Wang, Tigelaar and Admiraal, 2021; Eksail 
and Afari. 2020), however there are not many studies examining how to induce educators to change 
attitudes towards the use of ICT, in terms of understanding its true added value in teaching itself from a 
didactic point of view and increasing their motivation to use ICT in teaching. For example, Tomczyk et 
al. (2020a) concluded based on research that teachers tend to be more of “techno-optimists”. Hanafi et 
al. (2017) addressed the reasons for the low motivation of university students to participate in the ICT 
use course in teaching (e.g., due to a lack of experience in ICT). His experimental study examined the 
impact of the new augmented reality mobile application (MARLA) on the motivation of students to attend 
an ICT university course. The research consisted of 120 non-technical undergraduates specializing in 
social sciences with an average age of 19.5 years. They were divided into an experimental group and a 
control group. The dependant variable was the motivation of students to learn and independent variables 
were the method of learning and gender. The experimental group used the MARLA app on their mobile 
devices to adopt one of the course topics — ICT competencies, while the control group used a similar 
application on their desktop computers. An analysis of covariance was performed which showed that 
boys were more motivated than girls using a mobile app. On the other hand, no effect attributed to 
the method of learning was observed. The authors concluded that it is likely that a mobile educational 
tool can be used to help non-technical college students learn with greater motivation, but its success 
will depend on proper planning and implementation considering the different needs of boys and girls. 

Although the use of ICT in education Is very extensive and widely discussed, there are currently many 
meta-studies that bring undetected discoveries in this area. Zhang, Basham and Yang (2020) conducted 
a meta-study where he identified and synthesized 71 empirical studies related to the implementation of 
personalised learning conducted between 2006 and 2019. Meta-study shows positive effects of the use of 
ICT in personalization of teaching, both for students themselves and teachers. The following technologies 
appeared in the studies under review: web-based adaptive learning systems, intelligent tutoring systems, 
educational computer games, virtual reality systems, computerized adaptive assessments, mobile 
applications and multimedia tools for digital storytelling. In conclusion, it notes that personalisation of 
learning with the help of ICT is by no means a simple task that can be solved by short-term research 
or intermittent implementation. Personalisation of teaching with the help of ICT will require decades of 
joint efforts by different stakeholders to bring a promising innovation of education to reality. Talan (2020) 
conducted a meta-study of the effects of mobile learning. The main purpose of this meta-study was to 
determine the impact of mobile learning on students’ learning performance. One hundred four studies 
conducted between 2009 and 2019 that met the criteria for inclusion were subjected to meta-analysis. The 
study sample consisted of 7 568 participants. Results showed that the influence of mobile learning did not 
change students’ learning performance based on the level of education and the period of implementation 
but changed the study performance based on the subject (p<0.05). This interesting finding confirms that 
mobile learning effectively targets the content of a particular subject and can increase students’ learning 
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performance, probably by increasing their motivation and due to mobile platforms being easily available. 

Eksail and Afari (2020) also found links between teachers’ attitudes towards ICT and their use 
in teaching. His research concluded that the perception of the usefulness of the use of ICT in teaching 
can improve attitudes towards the use of ICT. A very interesting research of the attitude towards ICT 
in education was also carried out by Tomczyk et al. (2020b), who tried to answer the question “How 
does the attitude to New Media influence the evaluation of a new e-learning platform among current 
and future teachers?” One of his conclusions was that a positive attitude to media in one area of 
use, €.g., private, is linear with a positive attitude in another area. Snijders et al. (2018) attempted 
to predict where the use of ICT in the educational process will go. Based on the knowledge from his 
Studies, he predicts that the role and position of the educator will change. Thanks to the massive use 
of ICT, the traditional approach to teaching is expected to be just one of many ways of education. 


Research Review (in Brief) 


Since our department is preparing teachers (our andragogy students are or will be teachers, 
teachers, adult educators, principals and other roles), we have tried, within our possibilities, to conduct 
research that would answer the research problem P, what is the effect of a one-off demonstration 
of the use of ICT in teaching andragogy students on their change of attitude towards the use of ICT 
in the field of education. That is why we have formulated the following three research questions: 

¢ Does a one-off demonstration of the use of ICT in university teaching influence the opinion of 
andragogy students about the impact of the use of ICT on the understanding of curriculum and education 
and learning itself? 

¢ Does a one-off demonstration of the use of ICT in university teaching influence the immediate 
conviction of andragogy students to use ICT in their future teaching? 

¢ Does a one-off demonstration of the use of ICT in university teaching influence the inclination to 
act to recommend to your colleagues the use of ICT in teaching? 


Our choice of a demonstration was to use ICT as a tool for the understanding of curriculum or solving 
the problem. We were particularly interested in whether the use of ICT, namely the use of MS Excel in 
data processing and a short Python program in empirical verification of the results of a mathematical task, 
can have an impact on the change of three dimensions of attitude towards the use of ICT in education. 
When determining variables, we draw from the theory of attitudes and their dimensions in personality 
psychology (Nakonecny, 2009, p. 235). The first variable for us is the conviction of students of andragogy 
to use ICT in their future teaching (their personal emotional fixed opinion about the inclusion of ICT in 
teaching). This variable represents an emotional dimension (in short, we will call this variable “personal 
use’). The second variable is the opinion of andragogy students about the impact of the use of ICT in 
teaching on the understanding of curriculum (in short, we will call this variable “understanding’). This 
variable represents a cognitive dimension. The third variable is their opinion on the impact of ICT use on 
education and learning itself (in short, we will call this variable “teaching”. This variable also represents a 
cognitive dimension. The fourth variable is the tendency to act to recommend the use of ICT in teaching 
to their colleagues (in short, we will call the variable “recommendation’). This variable represents a 
conative (behavioral) dimension. Recalling the fundamental fact, our research does not have the ambition 
to examine these variables in a sophisticated way, but to compare their initial value corresponding to 
the initial state of students and their final value corresponding to the state after the experiment. The 
research focuses on finding a change in attitude towards the use of ICT in education (or changes in 
individual dimensions of attitude as a complex phenomenon). With appropriate questions, we check these 
variables in control and experimental groups before a demonstration of the use of ICT in teaching and 
thereafter. The variables “personal use’, “understanding”, “teaching” and “recommendations”, which carry 
the meanings of the dimensions of attitude towards the use of ICT in education in general, cannot be 
accurately measured, and therefore we choose a relative comparison of their measurement according 
to the bipolar 10-point scale so that we can easily check their change. We tried to find out whether an 
appropriate one-off demonstration of the use of ICT in teaching for students of andragogy — current and 
future educators (in this case, modelling the real situation using a written program that engages these 
students) will change their dimensions of attitudes towards the use of ICT in education, i.e. the rate of our 
four separate variables. Our research only measures variable change based on a one-off external stimulus. 
Nevertheless, in the event of a positive change, it may result, for example, in increasing the chances of 
andragogy students using ICT in their future practice or changing their long-term views on the use of ICT in 
education. However, the results should clearly tell us whether the inclusion of the demonstration of the use 
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of ICT in the teaching of andragogy students will affect their attitude towards the use of ICT in education. 

Summing up our research, its starting point is not only past studies more or less confirming the 
positive effects of ICT on education, self-education and learning, and studies on the effects of ICT use 
on future teachers, but above all the concept of external influence on changing a person's attitude. We 
draw from the theory of attitudes from personality psychology (Nakonecny, 2009). Our external impetus 
is the demonstration of the actual use of ICT within the university lecture, primarily focused on didactic 
methods. To what extent this simple innovation can be an important trigger for the immediate influence of 
a change in attitude towards the use of ICT in education Is the aim of our research. Digital competence 
theories are the ethical framework for determining the initial assessment of andragogy students. We find 
out the initial level of knowledge and skills, the relationship to ICT, but also the frequency of ICT use. 
We also base our research on the concept of Veteska and Kursch (2018), who summarize that for the 
success of education in the context of Education 4.0, important factors are “passion for a particular cause” 
and engagement. And it is these factors that may be related to the phenomenon we are investigating 
— the change of students’ attitudes based on their own experience. The advantage of our research is 
that our students do not primarily study mathematics or ICT, but andragogy and didactics, so we aim 
primarily at finding a change in attitude towards the use of ICT in education in an unprofessional group. 


Materials and Methods 


A total of 224 students of master’s and bachelor’s programmes in adult education at the 
Faculty of Education of Charles University in the Czech Republic participated in the research over a 
period of 3 years (2018, 2019, 2020). The participants of the experiment are in our terminology from 
the introduction “educators” and in the experiment, we will also synonymously call them respondents. 
The experiment was conducted a total of 8 times in 16 homogeneous groups. The groups were always 
chosen according to the participants of lectures of programs under andragogical programs according to 
the possibilities of the university, and if there were more participants in the control group or vice versa, 
the responses in this group were reduced according to random selection to the number of smaller groups. 
The groups thus met the homogeneity criteria in terms of the program studied, gender and number 
of respondents. Table 1 shows the parameters of each group. For the experiment, one of the groups 
was always experimental and one control. The control group held a seminar aimed at explaining the 
unconventional didactic method of AIDA on the example of a mathematical problem in the case of the 
birthday paradox (The birthday paradox is nothing new, more so, for example, in (Al-Khalili, 2012)), but 
the teaching did not use ICT as a support tool. The experimental group had the same seminar with the 
same task, but using ICT, namely empirical modelling of the birthday paradox using a simple Python 
program and modelling in the MS Excel spreadsheet program. For our experiment, we then aggregated 
all the results of the questionnaire, which was carried out before and after the experiment, into one 
final control group, consisting of 112 respondents, composed of all sub-control groups and one resulting 
experimental group of 112 respondents, consisting of all sub-experimental groups (see Table 1). 

Table 1 

Parameters of each group 





Degree 
Group men women SUM Year 





Program 
1 control 3 12 15 2018 Bachelor 
2 experimental 3 12 5 2018 Bachelor 
3 control 4 10 14 2018 Bachelor 
4 experimental 4 10 14 2018 Bachelor 
5 control 3 9 12 2019 Master 
6 experimental 2 10 12 2019 Master 
7 control 2 5 7 2019 Master 
8 experimental 2 5 f 2019 Master 
9 control 2 6 8 2019 Master 
10 experimental 3 5 8 2019 Master 
11 control 3 13 16 2019 Bachelor 
12 experimental 5 11 16 2019 Bachelor 
13 control 5 18 23 2020 Master 
14 experimental 8 15 23 2020 Master 
15 control 9 8 17 2020 Master 
16 experimental 9 8 17 2020 Master 
SUM 67 157 224 n/a n/a 
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The input data was composed of data from all 112 respondents of the resulting control and 
experimental groups. By homogeneity of the sub-groups, we guaranteed the overall homogeneity and 
representativeness of the sample and by merging the sub-groups we achieved the necessary size 
and sample. We thus created one large control group and one large experimental group consisting of 
responses from all respondents. 

In the experiment, we distinguish four input variables that determine the overall relationship of 
respondents to ICT, their ICT experience and skills, and four variables researched for which we find the 
degree of change in attitude towards the use of ICT in education in the experiment. When examining 
input variables, we considered the concepts of TPCK (Koehler et al., 2013) and DigComp (Vuorikari et al., 
2016). We are aware of the different relationship of respondents to ICT and the different initial knowledge 
and skills in this area. However, it would be very difficult for our research to find out in detail the position of 
respondents within TPCK and DigComp, or to carry out a deeper assessment, especially for time reasons. 
Levels of ICT competencies of university students in the Czech Republic, Poland and Slovakia were 
researched by e.g., Eger et al. (2018) in his comprehensive study. That is why we chose the simplified 
model and tried to identify four essential input variables for all respondents in all our groups. These 
variables are related to ICT (positive vs negative), estimation of their ICT skills (excellent vs insufficient), 
experience in the use of ICT in teaching or education (extensive vs none) and frequency of ICT use in their 
current work or their studies (very common vs. not at all). Here we base our ideas on Eger et al. (2018), 
who, based on research, has concluded that “frequencies of ICT use for school and leisure-related tasks 
are crucial determinants of students’ ICT competence”. We used a 5-point Likert range to determine the 
rate of these input variables. Based on the inspection and check-up of input variables, we can detect 
possible correlations or dependencies on our variables under investigation, as well as possible anomalies 
in data or non-standard deviations, for example, due to prejudice. We have separated all variables so that 
Our experiment can be repeated at any time, which is why we describe in great detail the AIDA method 
used and accurately describe the demonstration of the use of ICT for the experimental group. 

Before listing specific cases, we provide a short description of the AIDA method (from Attention, 
Interest, Desire and Action) in teaching. Polk (2018) in his study using the AIDA method demonstrated its 
positive effects in education. In Table 2, this method is described. The AIDA method in education and the 
creation of e-learning courses are also used by some commercial organizations (e.g., B-online learning, 
see httos://bonlinelearning.com/using-the-aida-model-to-get-buy-in-elearning/).It can be understood as a 
didactic method taken from marketing, which, in combination with the use of digital technologies, can 
arouse the interest of students or pupils in the problem, and itself create an engaging atmosphere in 
teaching, which can be applied in the introduction to the problem, new teaching or project learning. By 
combining this method using digital and communication technologies, we can achieve synergistic effects 
that increase the overall learning efficiency of students and pupils. 








Table 2 
AIDA method in education 
Phase Phase objective 
Attention The aim is to create a stir among students or pupils. It can be inferred, for 
example, by a riddle, a suitable question, a description of a paradox, a 
description of a shocking discovery. This phase is always an input phase 
and should not be too long. 
Interest The aim is to arouse interest in the given problem, the subject, the task. 
This stage always follows the stage of attention and is intended to develop 
it. It is a process of explaining, clarifying a problem, a curriculum, or a 
project, but not showing its solution. The inducement of interest may be 
gradual, so this phase is aimed at clarifying the whole problem in detail. 
Desire The goal is to induce desire. At this stage, students and pupils should move 
to a state where they want to solve the problem, master the curriculum, 
figure out the essence of the matter or start the project. 
Action The aim of this phase is that students and pupils will take action. That they 


will create solutions for the problem, for example, using ICT to start 
implementing the project, mastering and managing the curriculum. They 
will begin to broaden their horizons and continue to ponder the problem on 


their own. 
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Our andragogy students are also taught this method as a didactic tool. In our experiment, we teach 
the AIDA method on the problem of the birthday paradox, which Is suitable, for example, in the teaching 
of combinatorics or as a complement to the teaching of probability. However, it also points to a paradox in 
the estimation by quick-thinking (Kahneman, 2011). It can be used to explain the dysfunction of intuition in 
seemingly simple tasks. Many students will remember such tasks for life, and therefore they are suitable 
for the introduction to the issue of paradoxes. In our experiment, all sixteen groups learn all phases of 
the method, but the last phase of the method - action — is accompanied only by a paper and pencil 
calculation in eight control groups. For eight experimental groups, ICT is used to the maximum extent 
possible in the last phase of the method — action. The full use of ICT as a didactic tool is incorporated into 
the action phase. The first action of educators in all groups is therefore a mathematical calculation. For 
this, a simple calculator is enough, but only for one n ata time. This ends the control groups. Experimental 
groups continue modelling case for different n and educators are assigned a modelling task in the MS 
Excel spreadsheet program. In Figure 1, you can see very well the results of this modelling, solutions for 
different n. Educators realize that the probability does not grow linearly, and even at 47 people, it reaches 
a staggering 95%, which often inspires astonishment. 


100.0% + 
90.0% + 
80.0% + 
70.0% : TT 
60.0% - 
50.0% + = nb people 
40.0% ® probability 
30.0% : 
20.0% | 
10.0% ; 
0.0% + 


1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 
Figure 1. Solving the birthday paradox task for different n (“nb” means “number of’). 


From our experience, we still meet students who, despite the mathematical calculation mirrored 
in the Excel table, doubt it. This task is counter-intuitive, so it is advisable to use another ICT tool for 
empirical verification. For example, there is a widely used tool - Python programming language. For 
our task, we have used the Python programming language in the Jupyter (httos://jupyter.org/try) online 
environment, which requires no installation and can be operated online on the web. For modelling via the 
Python program created by us, we can enter the number of randomly selected people and the number of 
repetitions of the experiment with this group. Such a model induces a real situation. Below is a program 
that is written in such a way that even students who do not program themselves can trust it and understand 
it. Therefore, it is a good idea to explain the program line by line, preferably using embedded notes. 


importing random #loading module to generate random numbers 
people = int(input(“number of people selected:”)) #setting number of groups of people from the 
keyboard 


attempt = int(input(“count retries:”)) #setting number of attempts from the keyboard 
match = 0 #initiation number of birthdays matches at the beginning zero match 


for i in range(attempt): #cycle conducting experiments 

b = [] #set b days of birth of randomly selected people 

for y in range(people): #cycle fulfilling set of dates of birth (order of days in the year) 
day = random.randint(1, 365) #random date selection 

if day in b: #if date already exists in the set, 

match += 1 #then one match is added 
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break #a goes on another try 
b.append(day) #else date is assigned to set b at the end 


print(f'In {attempt} attempts, {match} could be found”) 
print(f’In {attempt} attempts, match ability was {match*1000//attempt/10} %") #writes off test results 


Students can then try to enter different number of attempts and groups online. For example, for 
n=10 to 80. Table 3 shows the results of the outputs of the program for different n. 








Table 3 

Results of randomly selected groups of people who matched birthdays 
experiments/people n=10 n=23 n=30 n=60 n=80 
100 11.0% 46.0% 73.0% 98.0% 100.0% 
1000 11.3% 51.6% 68.7% 99.5% 100.0% 
10000 11.8% 51.1% 70.9% 99.4% 99.9% 
100000 11.6% 50.6% 70.4% 99.4% 99.9% 





such verification can no longer be doubted, and the proof is valid. In this example, the use of ICT 
for teaching is also a demonstration of a powerful tool that we would find very difficult to supersede in real 
life. One hundred thousand attempts in one minute were an unthinkable dream decades ago. But why did 
we choose the AIDA method? Why did we use the role of the birthday paradox? We wanted to minimize 
any negative effects of an inappropriately chosen method that does not in itself appeal to students, that 
will be boring or untested. This method, combined with an unconventional role that carries a paradox, 
guarantees a high motivation of andragogy students and their maximum interest. As a result, we are very 
likely to exclude other unwanted factors that could act as other variables representing disturbing elements. 

For research questions, we set the following zero hypotheses: 


HAO: Demonstration of the use of ICT in the teaching of andragogy students does not affect their 
opinion on the impact of ICT use on education and learning itself. 


HBO: Demonstration of the use of ICT in the teaching of andragogy students in teaching does not 
affect the convictions of andragogy students to use ICT in teaching. 


HCO: Demonstration of the use of ICT in the teaching of andragogy students in teaching does not 
affect their inclination to act to recommend the use of ICT in teaching to their colleagues. 


HDO: Demonstration of the use of ICT in the teaching of andragogy students does not affect their 
opinion on the impact of the use of ICT on the understanding of teaching. 


Finally, in Figure 2, we present a framework diagram of our experiment, including capturing the 
entire experiment process. The method for measuring input variables was a questionnaire using a 5-point 
Likert scale. The method for measuring the variables under study during the experiment was the bipolar 
10-point scale. It is a scale that can measure the dimensions of the respondent's attitude towards ideas, 
concepts, subjects, people, etc. Anon-parametric test for categorical variables — goodness of fit test - was 
selected as a test statistic. The same methodology was used for all divided groups in all 3 years. As a 
criterion for changing the overall attitude towards the use of ICT in education in respondents, we chose 
the condition that we reject at least three out of four zero hypotheses. Otherwise, we will consider the 
attitude towards the use of ICT in education unchanged. The research tool of initial assessment as well 
as of experiment part was designed by the researcher according to his previous studies (Veteska and 
Kursch, 2018). The tool shows internal coherence. Initial assessment includes 4 variables of evaluation 
and shows coherence — McDonald’s w = 0.745; Cronbach’s a = 0.766; Gutmann’s A6 = 0.776. The 
experiment part includes 1 item — attitude towards the use of ICT in education which consists of 4 variables 
(representing dimensions of attitude) and shows coherence before experiment — McDonald's w = 0.896; 
Cronbach's a = 0.893; Gutmann’s A6 = 0.886 and after experiment — McDonald's w = 0.902; Cronbach's 
a = 0.899; Gutmann’s A6 = 0.877. 
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Figure 2. Experiment description schema. 


Results 


First, we present the results of our respondents’ input responses. Respondents commented on 
questions about their relationship to ICT, estimation of their skills in the use of ICT, their experience in the 
use of ICT in teaching or education and the frequency of use of ICT in their current job. Answers to all 4 
key questions are categorized in Figure 3. 5-point Likert scales with the following key were chosen for 
the assessment: skills (1 — excellent 5 — insufficient), attitude to ICT (1 - very positive 5 — very negative), 
experience (1 — extensive 5 — none), frequency of ICT usage (1 — very often 5 — not at all). 


60% 
50% 
40% 
30% 
20% 
10% 


0% 
1 (<-High) 2 3 4 5 (->low) 


comme ICT Skills = Relation to ICT = ICT Experiences ==. Frequency of use ICT 
Figure 3. Respondents’ responses to their ICT skills, the experience of using ICT in teaching, 
frequencies of use of ICT in work and their relationship to ICT (scale 1-5). 
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The input responses allowed us to find possible disruptive phenomena or prejudices of respondents 
that could then explain the extreme values measured during the experiment. In our case, however, we 
found no anomalies. Table 4 shows relations among input variables via similarity matrix. 


Table 4 
Similarity matrix (created with IBM SPSS Statistics based on Pearson's correlations) 


Proximity Matrix 
Rescaled Correlation between Vectors of 
Values 


relation skills experience frequency 


relation 1.000 0.588 0.807 0.815 
skills 0.588 1.000 0.782 0.741 
experience 0.807 0.782 1.000 0.830 
frequency 0.815 0.741 0.830 1.000 


However, from the results of the experiment, we found very interesting findings regarding our 
researched dimensions of the attitude of andragogy students on the use of ICT in the education. As 
a test hypothesis of the experiment, we used the Chi-Square goodness of fit test. We calculated the 
comparison of expected and measured values for each individual before and after using a goodness of 
fit test. The expected test value (considered for each individual as their initial pre-teaching input value) 
and the experimental measured value (the actual value measured after teaching in both the control and 
experimental groups for each individual) were measured on a 10-point bipolar scale. The degrees of 
freedom were 111, as each respondent is part of one value. Critical values match levels a=0.05, a=0.01 
and degrees of freedom: 

X 70.95(111) = 136.591 

X70.99(111) = 148.571 

In the experimental group, we look for all values (Values 72 motivation (162.439), understanding 
(136.140), recommendations (139.870), impact (160.619)) greater 42>22 0.95(111) which imply the 
difference between the detected and expected frequency is statistically significant at a significance level 
of 0.05. On the contrary, for the control group, all values (Values y2 motivation (75.276), understanding 
(22.117), recommendations (16.582), impact (73.267)) are 72< 72 0.95(111). We therefore refuted 3 zero 
hypotheses HAO, HBO and HCO. Table 5 shows the results of the goodness of fit test for the experimental 
and control groups. 








Research results for experimental and control groups for our examined factors (p values) 
ICT in teaching (p values) Personal use Understanding Recommendations Learning 
control group 0.9962 1.0000 1.0000 0.9978 
experimental group 0.0011 0.0528 0.0332 0.0015 





Assuming that the variables under examination give us an equal indication of a change in attitude 
towards the use of ICT in education and the fulfilment of our established refutation criterion of at least 
three out of four zero hypotheses, we can conclude that we have demonstrated a statistically significant 
positive effect of the demonstration of the use of ICT in teaching of andragogy students on their change 
in attitude towards the use of ICT in education. In more detail, a statistically significant positive effect on 
the change in the cognitive dimension of attitude towards the use of ICT in education — an opinion on 
the impact on education and learning itself, a positive effect on the change in the conative dimension of 
attitude towards the use of ICT in education — a tendency to recommend to colleagues the active use of 
ICT in teaching and education, and a change in the emotional dimension — the conviction to use ICT more 
in their future teaching. Only for the influence on the change in the cognitive dimension of attitude towards 
the use of ICT in the education of andragogy students — the opinion on the impact of the use of ICT in 
teaching on the understanding of curriculum was p>0.05. Therefore, we could not unequivocally refute 


www.ijcrsee.com 
129 


Kursch, M. (2021). Impact of a one-off demonstration on the use of ICT in the teaching of andragogy students on their change 
of attitude towards the use of ICT in education, International Journal of Cognitive Research in Science, Engineering and 
Education (IJCRSEE), 9(1), 121-134. 


the zero hypothesis HDO, but it should be noted that p, in this case, was p = 0.0528, |.e., we are at the 
limit of statistical significance. According to our established criteria, we confirmed the overall signification 
of the ICT demonstration in teaching on changes in attitudes towards the use of ICT in education among 
andragogy students. Furthermore, we found that for students who reported their relationship to ICT itself 
as negative or very negative (input variable), the demonstration of teaching using ICT did not have a 
significant impact on their change in attitude towards the use of ICT in education. This has been confirmed 
for all dimensions. This was also the case for respondents reporting little or insufficient skills, very little 
experience of using ICT in teaching and low frequency of ICT use in teaching. Our results confirming 
Statistical insignificance for these groups are given in Table 6. These findings could indicate that a negative 
relationship with ICT and a lack of skills may indicate resistance to a change in attitude towards the use 
of ICT in education, even after demonstrating the use of ICT in teaching, its effectiveness and positive 
aspects. However, for such conclusions, we would need further research aimed at finding this correlation 
or causality. 


Table 6 

Research results for the experimental group where respondents gave a negative relationship to 
ICT, low or insufficient ICT skills, poor experience using ICT in teaching and low frequency of ICT use in 
teaching (p values) 








ICT in teaching (p values) Personal use Understanding Recommendation Learning 
4.5 ICT relationship p> 0.05 p>0.05 p>0.05 p>0.05 
4.5 usage rate n/a p>0.05 p>0.05 p>0.05 

4.5 skills n/a p>0.05 p>0.05 p > 0.05 





A complementary fact was that there are no significant statistical differences between men and 
women. For completeness, we conducted coherence of questionnaire of psychometric properties to verify 
the reliability of the entire test, covering the researched variables containing responses according to the 
10-point bipolar scale, which was 0.893 before and 0.899 after experiment. Cronbach's Alpha has been 
calculated classically with the omission of one item. IBM SPSS Statistics (build 1.0.0.1447) software 
was used for the calculation as well as all other values mentioned in part of research tool description. 
Descriptive statistics of our responses before and after the experiment are given in Table 7. 


Table 7 
Descriptive statistical parameters of the responses (values 1-10) to be answered before and after 
the experiment was conducted in both groups. 








Item N sum Average Median Modus Sd Var Min Max 
before 1 224 1202 or * + 2.10 4.39 1 8 
before 2 224 1119 9.00 9 5 1.71 2.93 2 8 
before 3 224 1319 9.89 5 8 i i i E | 1 10 
before 4 224 1294 9.78 9 9 far )0 Af 1 10 

after 1 224 1370 6.12 6 ) 199 3.97 1 9 
after 2 224 1362 6.08 6 < 1.96 3.82 2 10 
after 3 224 1569 7.00 t + 230 539 1 10 
after 4 224 1556 6.95 6 9 239° 9.1/2 1 10 





Let us review the goals we set at the beginning of this study. Research questions related to the 
research problem P, what is the influence of a one-off demonstration of the use of ICT in teaching of 
andragogy students on change of their attitude towards the use of ICT in the field of education. 

¢ Q1: Does a one-off demonstration of the use of ICT in university teaching influence the opinion of 
andragogy students about the impact of the use of ICT on the understanding of curriculum and education 
and learning itself? 

Our findings show that demonstration of the use of ICT in teaching influences a change in the 
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cognitive dimension of attitude towards the use of ICT in the education of andragogy students about the 
impact of ICT use on the understanding of curriculum and education and learning. Change of opinion 
on the impact of the use of ICT on education and learning itself can be statistically significant (p<0.05), 
for the experimental group the point value of the 10-point bipolar scale increased by 1.879 on average, 
as opposed to the control group, where it increased by only 0.375 points. The knowledge of the change 
of opinion on the understanding of curriculum through the use of ICT also supports a positive answer to 
the question regarding the decisive role of ICT to understand the current problem, although we cannot 
confirm statistical significance (p>0.05) based on the results. However, we cannot rule out a high degree 
of influence, because in this case, the experimental group on the 10-point bipolar scale gave values 
in an average of 1.805 higher after the experience with ICT in solving the task of the birthday paradox 
(measured p was 0.0528). 

¢ Q2: Does a one-off demonstration of the use of ICT in university teaching influence the immediate 
conviction of andragogy students to use ICT in their future teaching? 

In the question aimed at determining the influence of the change in the emotional dimension of 
students’ attitudes towards the use of ICT in education — the conviction to use ICT in their future teaching 
based on their own experience with it and its use in didactics teaching, the results were unequivocal. 
The change in conviction in the use of ICT in their future teaching in the experimental group represents 
a higher increase in the 10-point bipolar scale compared to the control groups. On average, the score 
for the experimental group increased by 1.097 points compared to the control group, where it increased 
by 0.389 points. Here we could point out that the conviction to use ICT in teaching increases after a 
specific demonstration and understanding the importance of using ICT in a didactic process as opposed 
to ignorance of such an impact in control groups. Nevertheless, we remind you that based on the analysis 
of input variables, this effect is measurable only for students with a positive relationship to ICT. 

¢ Q3: Does a one-off demonstration of the use of ICT in university teaching influence recommending 
the use of ICT in teaching to their colleagues? 

The change in the conative dimension of the attitude towards the use of ICT in education — the 
tendency to act to recommend the active use of ICT in teaching and education to their colleagues confirms 
to us that, together with the change of conviction in the use of ICT in their teaching, the tendency to act to 
recommend the use of ICT tools in teaching to their colleagues increases. It is an interesting phenomenon 
that one demonstration was enough to increase the recommendation rate. The 10-point bipolar scale 
averages 1.831 change for the experimental group versus 0.380 for the control group. This finding 
may point to the fact that careful and fair teaching of the use of ICT for andragogy students positively 
influences the spread of good practices among other educators. We can also assume that thanks to the 
recommendations, the expansion of effective ICT teaching tools among educators — educators and adult 
educators across many disciplines of teaching can happen. 


Discussions 


Based on the results of our experiment, using statistical analysis, we confirmed 3 hypotheses that 
there are positive links between the demonstration of the use of ICT in teaching and the change of attitude 
towards the use of ICT in education by andragogy students. This means that the use of ICT in the teaching 
of future educators will lead to a higher use of ICT in their own teaching and to the promotion of the use 
of ICT in education. This result is in line with some recent previous studies on the positive effects of ICT 
use in teaching (Hardman, 2019; Mlambo, Rambe and Schlebusch, 2020 ; Willis et al., 2019; Hammond, 
2017; Garzon et al., 2020) and attitude towards the use of ICT in education (Eksail and Afari, 2020; 
Tomcezyk et al., 2020b). 

Our study should be evaluated in terms of objectivity and consider any valid objections to the 
research itself. In our research, we paid attention to the separation of variables. The groups were 
homogeneous in terms of the distribution of men and women of the same number of respondents and 
in terms of the diversity of the input parameters of our respondents — andragogy students. The selection 
of individual participants of the group was random from the beginning, included in the given university 
division by subject. We looked at three dimensions of attitude towards the use of ICT in education, 
represented by four variables: the conviction to use ICT in teaching; opinion on the impact of ICT use on 
the understanding of curriculum, opinion on the impact of the use of ICT on education and learning itself; 
and the inclination to act to recommend it to their colleagues in teaching. We also looked at the input 
parameters of respondents’ relationship to ICT as a default state to separate possible relations with the 
student's prejudices on ICT as such or to eliminate abnormalities. We asked test questions to identify four 
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factors to experimental and control groups at the same time, a week before their experimental teaching 
and a week after their teaching. Thanks to the minimum time interval, we eliminated other possible 
influences during this time, but at the same time, we eliminated the immediate effect of responses “just” 
after experimental teaching. Separation and balancing with the time interval thus performed ensured the 
maximum possible independent results. Thanks to the anonymization of respondents, it is also impossible 
to object to the possible influence of authorities. Furthermore, we used the most attractive content of 
didactics to eliminate any lack of interest of respondents in the content of the study. The relevant objection 
may then be the introduction of respondents to the subject of the research and its purpose, but this 
should not affect the differences in responses, since even the initial state was detected after the initial 
communication, but with a gap of weeks, since the communication was carried out at the beginning of the 
term. 

What we see as a key challenge for our research is whether our identified influence is permanent or 
only temporary, induced by a positive experience and a one-off teaching experience. We would certainly 
suggest further research in this area, regarding this issue. It would be advisable to repeat our experiment 
to confirm the results mentioned by us and to carry out new research to determine the permanence 
of positive influence. ICT certainly has a great future in education and learning. In particular, new ICT 
such as augmented reality, virtual reality has promising results in its use in the field of education and 
learning. Therefore, we should go down the path of increasing digital competencies (Hanafi et al., 2017) 
of our future educators and adult educators. The development of digital competences is essential for 
the application of the individual within the profession, but also in social and civic roles (Veteska, 2016). 
It will take constant improvement, adaptation and rational approach so that we do not get into extreme 
positions, prevent inefficiencies and help build an environment in which all educational participants feel 
comfortable working with ICT and their practical applications on this path. 


Conclusions 


Our results have come to explicit conclusions that confirm the positive effects of the demonstration 
of the use of ICT in teaching to change the attitude of andragogy students on the use of ICT in education. 
These changes are particularly reflected in students with an “a priori” positive relationship to ICT. Our 
specific recommendation is to focus in particular on demonstrating the use of ICT in education in 
the areas of real-world modelling using simple programs or applications, simulation of real events in 
virtual laboratories, solving complex problems using advanced big data processing tools and dynamic 
visualizations of the results of real-world variable relationships. If our research were to be repeatedly 
confirmed, we could realize that, from a didactic and methodological point of view, demonstration of the 
use of ICT in teaching as a tool for understanding of curriculum or solving the problem is an effective means 
of influencing changes in attitudes towards the use of ICT in education, and thus an argument to include 
these demonstrations across university subjects for andragogy students (andragogy students, educators, 
education advisers, education managers, principals and others). The results could give impetus to the 
more frequent inclusion of the use of ICT in university teaching of future and current educators to enrich 
this teaching with interesting and effective didactic ICT tools, which will then be promoted by university 
graduates themselves across many disciplines and specializations. 
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Abstract: Music education is an important factor of students’ development. The positive effect of music training Is 
evident in all areas, from the intellectual, psychomotor to social and emotional ones, and therefore music classes in the music 
school should focus both on music making and on experience, understanding and evaluating music, as well as on expressing 
one’s own ideas, feelings and thoughts. In ear training classes it can be achieved through the area of music listening. Didactical 
initiatives of the 19th and 20th century contributed to the recognition of the advantages of the auditory approach, while technological 
innovations allowed the practical application of music listening. Although there are examples that point to fostering the emotional 
experience in music classes, music listening Is still focused on giving assignments of cognitive type and learning about music 
components. Some exceptions pertain to the application of multimodality in music teaching using both musical and extra-musical 
areas. The paper is aimed at pointing to the value of the cognitive-emotional music listening and to the possibilities it opens in ear 
training classes. The cognitive-emotional music listening focuses on experiencing, understanding and appreciation of classical 
music aimed at shaping students’ worldview and improving their music competences. It can be achieved by the multimodal and 
interdisciplinary approach to a musical piece. Students learn about the musical-historical context of the emergence of a piece 
in a given time and circumstances, about the composing approach and the theoretical and harmony features of the work, they 
develop their musical and critical thinking, make music, and evaluate both music and their own achievements. Repeated listening 
to a musical piece or excerpts from it, observing and familiarizing with the piece from different perspectives and discussion 
about the piece and experience after listening make it possible to better understand the piece and its specifics, as well as to 
discover and improve one’s own self and accept others and the different. 

Keywords: art education, cognitive-emotional music listening, ear training, music school. 


Introduction 


The education system of the countries that succeeded Yugoslavia preserved the same concept: 
primary, secondary and higher education. Besides the compulsory primary education, free art education 
is also available. It is legislatively regulated, and available to every child under equal conditions, and its 
aim is to foster and improve children’s intellectual, emotional, social, as well as creative and aesthetic 
development. Aims of art education focus on experience, knowledge acquisition, skill development and 
understanding of various aspects of arts and works of art, ultimately aimed at their competent evaluation 
(Nacionalni kurikulum za umjetnicko obrazovanje, 2017). The macroconcepts it is based on focus on 
knowledge acquisition and development of art skills, understanding the language of art as well as to 
creative expression on the one hand and, on the other, on students’ social and emotional development 
underlining the fundamental life values such as respect for differences, patience, tolerance and empathy. 
Within music education, students acquire musical knowledge and skills, make music, promote music 
through public activity and improve musical culture of the environment the school works in. Additional 
music education influences their musical as well as overall development, whereby a particular attention 
should be devoted to the emotional and social component. 

Recent research points to the positive aspects of music education and involvement in music as 
an essential activity in personality formation. Besides the acquisition, development and improvement 
of music competences, involvement in music also fosters the development of multiple intelligences 
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(Armstrong, 2006; Gardner, Kornhaber and Wake, 1999). Studies conducted by Gibson, Folley and Park 
(2009), Hille et al., (2011), Schellenberg (2011), Schelenberg and Mankarious (2012) point to the direct 
association between involvement in music and improvement of IQ. Association between musical training 
and cognitive abilities are highlighted by Schellenberg (2005, 2016), who also points out that music 
develops spatial abilities, which is also confirmed by Bilhartz, Bruhn and Olson (1999), Hetland (2000), 
Rauscher (2002) and Zafranas (2007). Findings of the research by Chan, Ho and Cheung (1998) and 
Ho, Cheung and Chan (2003) indicate association between music and verbal memory. Schwarzer, Lippke 
and Luszczynska (2011) notes that music curriculum in schools leads to the improvement of students’ 
visual and aural memory. Gruhn (2002) and Zachopoulou, Tsapakidou and Derri (2004) claim that the 
beneficial effect of music lessons reflects on children’s psychomotor development, while Schellenberg 
(2016) notes that musical training also influences the development of students’ social skills. Musical 
training also contributes to the development of self-esteem, self-confidence and self-control (Rickard 
et al., 2013), empathy (Kirchner and Tomasello, 2010; Rabinowitch, Cross and Burnard, 2013), self- 
confidence and motivation (Hallam, 2010). It is enhanced by, e.g., students’ joint music making, when the 
attention focuses on the group and when every individual has the opportunity to develop their social and 
emotional skills, kindness, support, empathy, understanding and respect. Development and improvement 
of students’ abilities, knowledge and skills, learning of values and establishing a critical distance in terms 
of adopting and permanently bonding to music, culture and art is the goal of music education and, at the 
same time, the pedagogical and educational function of music classes. In doing so, models and strategies 
of delivering classes, intensity and duration of education certainly affect the final outcome. 

Experience, understanding and evaluation of music by expressing one’s own ideas, feelings and 
thoughts also relate to teaching fundamental life values. Vidulin (2015, 2020), and Vidulin, Plavsic and 
Zauhar (2020) see the direct possibility to achieve this in the area and activity of music listening, which 
influences children’s full development. Music listening arouses senses and reaches affective layers 
leading to the emotion utterance. The experience of music in its entirety in the atmosphere of relaxation 
contributes to the group integration, decreases inhibition, improves interpersonal relations, and binds 
emotion and creativity uniting in the aesthetic. 

Although listening is the most natural way to experience and learn music, it is actually a form of 
work which was the last to be inaugurated in the practice of music teaching. Designing a serious strategy 
of teaching by means of music listening was allowed only by the technological advancement of the society. 
Although there is a well-elaborated didactical approach to music listening in school, in the omnipresence 
of music in the 21% century the teacher Is facing new challenges: how to motivate students, increase their 
attention and contribute to the acceptance of art music. 


Ear training: from rational reflection to auditory vividness 


Development of music pedagogy is mostly a result of historical and other circumstances and norms 
which were generally accepted in a given moment and at a given place, rather than a sequence of logical 
events or consideration. Some initiatives had a continuity of development regardless of the speed of 
their dialectic path, while others have been lost forever in the maze of millennium-long expanses (Kazic, 
2013). The passage through centuries of efforts and endeavours of music pedagogy and music teaching 
methods testifies of the multiplicity of procedures, methods and directions, from the elementary ones such 
as training the children voice and music education by means of children songs, through various didactic, 
mnemotechnic and graphic aids, to the attempts to foster and raise interest in music in musical and non- 
musical way. 

During the 19" century, numerous innovations were inaugurated in the area of music teaching. 
Most authors, regardless of different didactical solutions, always suggest that the auditory way of 
implementation should precede the visual one, |.e. point to the primarily auditory perception of musical 
terms before the adoption of graphic marks. The fact that it was only paying lip service is confirmed by 
the insight into numerous music textbooks and manuals of the time, which primarily and almost as a 
rule began with music literacy before any other auditory event in the class. Knowledge gained by means 
of active listening to music models and examples was also a rarity, except when teachers were able to 
perform something on their own. 

Frenchman Wilhem was one of the most influential music pedagogues of the 19" century. He 
proposes the auditory approach in music education, before mastering music notation and learning theory, 
i.e. performing. His approach encompasses the identification of elementary sound structures such as 
notes (pitch level, loudness, source of sound, etc.) and possibly the perception of the size of intervals. 
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Wilhem’s contemporaries, Swiss journalist and composer Nageli and Bavarian teacher Pfeiffer were the 
first to use the term ear training in their textbook Gesangbildungslehre nach Pestalozzis Grundsatsen 
(1810) which, among other procedures, introduced the musical dictation as a form of work. De Momigny 
also emphasizes the need for music to be judged by listening, since the auditory perception is more 
reliable than sheet music (Stefanija, 2008). Although ear training cannot be reduced only to listening 
training, it is still a significant point of origin, since it implies a kind of guided listening to a melody. The 
famous composer Schumann also affirmatively spoke of the comprehensive listening and, generally, of 
the need to listen to a musical piece several times (1849, aphoristic Advice to Young Musicians 39, 47, 50, 
92, 67), since he believed that a piece cannot be evaluated after a single listening. 

The concept of musical upbringing was inaugurated into the system of music education after 
1918, and the development of musical abilities was understood as a road toward the permanent musical 
thinking, with a particular importance being attached to the upbringing of conscious listening with auditory 
perception. It was believed that the clarity of musical structure while listening can emerge only through 
conscious experience and sensory ability; thus, refinement of musical ear was achieved by means of 
intellectual and rational reflection, without expressing the emotional, and even the aesthetic component. 

The perception of any sound phenomenon with a rational explanation are the basic principles of 
Battke’s pedagogy and are based on the auditory apperception. The term apperception, in the sense 
of the perceptively conscious inclusion into the existing content of consciousness, was first used by 
German philosopher, psychologist and teacher Herbart. Contrary to the ontological viewpoint of Battke, 
who perceived music as it is, differentiated from the subjective experience, Jaques-Dalcroze is decidedly 
against such a reduction of perception and response in education to a common level. He believes that 
musical communication should proceed first through the auditory sense and instinct, and only then through 
intellect, with rhnythmics as the most potent and most vivid element in music (Jacques-Dalcroze, 1921). 
The framework of Dalcroze method (Eurythmics) provides and develops a series of subtle procedures 
based on auditory cognition and rhythmics. Music listening proceeds in real time and with the teacher's 
live performance. The performance is often based on improvised parts performed by the teacher during 
the class, changing the tempo and melorhythmic structures consequent to the group’s responses, which 
in turn reinforces attention, experience, perception and thinking. Dalcroze’s idea Is significant because it is 
a completely original way and perhaps the first time in the history of the group music classes to provide the 
opportunity for continuous listening to music and only then, on this basis, to proceed with other teaching 
activities. 

Music listening which results in an experience, perception, emotion, analysis, cognition, thinking, 
aesthetic judgment etc., and which should be the fundamental disposition on the road to the adoption of 
musical knowledge was not realistically feasible before technology allowed it. During the second half of 
the 20" century, audio formats began to be used, and music could be listened to every day/the whole day 
and in any space. Thus Bresgen in his classes relies upon audiotapes and phonograph records (Bresgen, 
1960), which opens a completely new approach and new possibilities for teaching music with music in a 
real time, while music still goes on. 

In Alt’s concept of music education, in-class music listening has a completely specific and significant 
place. He believed that technical progress, which allowed the presence of music in every home, poses 
a potential threat, since such an approach to non-selective listening in a sense make people passive 
and distant from the artistic in music. Alt recognizes and points to the central task of music education, 
i.e. to the objective evaluation of a work of art. Alt (1968) believes that music listening makes it possible 
to learn about different styles and genres, which in turn can lead to a high-quality aesthetic evaluation, 
which distinguishes the mature listener. In the procedure of in-class music listening, he distinguishes 
three stages, from passive listening to sound sensations (notes, rhythms, harmonies etc.), which create a 
picturesque interaction and arouse emotions, through aesthetic listening during the active/guided music 
listening, to the inspirational listening, when music begins to inspire. Since sound/sonority is a symbol of 
mental states and music is a need or prerequisite for certain mental events, the prerequisite for inspirational 
music listening, according to Alt, is a particular degree of its understanding. It is therefore necessary to 
lead students toward the listening and perception that can objectively evaluate and categorize a multitude 
of musical impressions in everyday life. 

The second half of the 20" century witnessed an evident development of curricula where music 
obtained its syllabi with objectives, tasks and expected outcomes. They proposed contents which are 
considered basics of musical culture and the art of music. They also design various methods for its 
learning and strategies for teaching at different educational levels. The objective of teaching music that 
primarily pertained to singing by ear (in the didactic, rather than artistic sense), and then to singing by 
notes aimed at gaining music literacy (Vidulin, Plavsi¢ and Zauhar, 2020) is gradually changing. Music 
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listening is taking an increasingly significant place. In this respect it is possible to follow both didactical 
instructions and evaluation of music listening as an approach in education. 


Music listening in curricula and didactical manuals in the 
Western Balkans countries 


In the mid-20" century, music listening gained its place and has been present in music classes in 
the Western Balkan countries as one of music areas ever since. Overview of the curricula for teaching 
music in primary schools from 1946 to 2019 (see Vidulin, Plavsic and Zauhar, 2020) reveals that music 
listening was introduced in music classes in 1948, though it depended on the capacities of schools 
which, in the post-war period, were not equipped with teaching aids. In the post-war years, records and 
radio programmes were somewhere listened to in order to allow students to become familiar with music 
literature, which was a valuable contribution to music listening in schools. Curricula suggested pieces for 
listening and illustration of particular musical phenomena and concepts, and the attention was focused on 
getting familiar with music and musicological contents. At present, music listening also primarily focuses 
on the musical piece and its components, which results in the focus on the cognitive dimension of teaching 
music. 

In one of the first music didactical manuals, Pozgaj points out that the teacher can occasionally 
organize separate classes of music listening, which focus on the perception of the expressive elements 
of music, and the expression of impressions aimed at forming an aesthetic judgment. For Pozgaj, 
the primary function of music listening is an experience of a work of art, which is always of sentient 
nature, and therefore the importance is attached to preparation for listening, which will allow stronger 
impression on listeners. He distinguishes activities of preparation for listening, the experience of musical 
piece, understanding, expressing impressions, and judging and teaching. Pozgaj was certainly one of 
the first music pedagogues who comprehensively considered all aspects of music teaching, including 
the establishment of active listening, at the time when radio receivers were still a rarity. In a new edition 
of Metodika [Didactics], Pozgaj brings tape recorders and phonographs in the modern classroom of the 
time, together with the tape library and records library, radio receiver and television set. In these different 
circumstances, he believes that music listening is compulsory in every class, at least for a few minutes, 
and starting from the first grade. He links the sentient experience and mental activity, which he believes 
to imply the perception and comparison of the elements of musical expression, imagination, musical 
memory, analytic-synthetic understanding of musical form and forming aesthetic judgment. 

Rakijas distinguishes music listening by means of a mechanical device from listening in one’s 
own, live reproduction, which he considers more valuable in the educational sense. He distinguishes 
pieces from musical literature according to attributes used to describe music with: fantastic music, 
dramatic music, emotional music, programme music, etc. According to Rakijas, music listening fosters 
the experience, which is the consonance of emotional and mental activity. Plavsa, Popovic and Debeljak 
believe that music listening is empirical work. They focus attention on the piece components, aimed at 
grasping its formal structures, which in turn indicates the complexity of a creative act. In a similar way, 
Andree, Barosevcic, Basrak, Krulanovic, Kucukalic, Ludvig-Pecar, Pozgaj & Stevkovic suggest that when 
listening to music it is important to focus attention on the characteristics of a musical piece, i.e. on its 
expressive components. Such an approach will allow students to become more familiar with the music 
they probably do not listen to in their spare time. 

For Rojko (1982), work on musicological contents is part of the cognitive process while listening 
to music. At each repeated listening, instructions and assignments are given and the music is perceived 
through the prism of analytic-synthetic framework. The importance of giving assignments Is also pointed 
out by Hodzic, who suggests assignments that will allow listening to be careful and active, and children to 
be focused on the musical contents. The development of students’ perceptive abilities of music listening 
is associated with the entire process of adopting and understanding musical phenomena, so that they can 
get the opportunity to substantiate their views and opinions on the musical pieces they listened to and 
shape their aesthetic criteria. 

Insight into didactical manuals reveals the tendency to listen to music actively and mostly cognitively. 
Active listening to a musical piece focused on cognition implies the perception of musical - expressive 
components and formative structures of a musical piece, and distinguishing musical (theatrical music) 
types, ways of performance and performing ensembles. Before listening to a musical piece, students are 
given assignments which motivate them to actively follow, listen to and analyse the music. Perception, 
auditory identification and distinguishing musical-expressive components are gradually built upon through 
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education cycles. 

still, it can be observed in the teaching practice that assignments during music listening are 
identical for every piece, which ultimately does not contribute to its better understanding, and thus 
acceptance. Since every piece is labelled with a unique musical idiom, it is necessary to insist exactly on 
its distinctiveness, by which students will recognize it and distinguish it from others, and to emotionally 
include students in music listening and encourage discussion of emotional experiences and associations 
that arose due to listening (Vidulin, Plavsic and Zauhar, 2020). 


Multimodal concepts of music listening in schools 


Although it primarily focuses on music, music listening can also be viewed in comparison with other 
musical and extra-musical areas and activities. In this context, we speak of multiple modalities in music 
teaching. Multimodal approach can spur better achievement and greater motivation (Yu et al., 2010) and 
allow the creation of more association in experiences (Mayer, 2001). 

Novelties in the area of listening to classical music with a multimodal and interdisciplinary approach 
were introduced by Vidulin (2015; 2017; 2020; Vidulin-Orbanic, 2013). Listening to Music — Music Making 
(LMM) approach and Stage-English-Music (SEM) concept were designed with the aim of promoting 
classical music among children and youth, so that they can better understand and accept it. While the 
LMM approach views music through/with music, SEM Is of interdisciplinary character. 

LMM approach is based on the immediate connection between music listening and composing 
and comprises both the cognitive and the emotional context. School-age children’s composing is often 
associated with the knowledge of certain music components which they perceive while listening to musical 
pieces. The model is specific in that children first get familiar with music through music and then create/ 
compose It. In doing so, the model makes use only of musical activities. Singing and playing, as the most 
frequent way of connecting music listening with other areas of music directly affect knowledge and skills 
and enhance emotional reception of music in children. 

Exit from the exclusively musical zone is allowed by the SEM concept, which proposes music 
listening in combination with other, both musical and extra-musical activities and areas. The multimodal 
approach influences the culture of listening to classical music, familiarizing with it, understanding and 
accepting it. Students gain knowledge of musical-style periods, of characteristics of a given piece and its 
artistic values, they get to know the composer and his life, which affects the cognitive and emotional level 
of teaching. A particular contribution to the concept is provided by drama education and foreign language 
(English), which influences students’ general culture, developing their musical, drama and language 
skills. Work with students according to the SEM concept emphasizes students’ activities and immediate 
experience. Listening to the world around them and critical thinking develop students’ imagination, 
influence their behaviour, express views, shape beliefs, identify and express emotions whereby children 
learn about and discover themselves and the world around them. 

As the response to the question as to how regular music classes can become and permanently 
remain an inciting and creative environment, the cognitive-emotional music listening was introduced 
(Vidulin, Plavsi¢ and Zauhar, 2020). Multimodal interactive ways of work using multimedia are proposed 
for completing cognitive and emotional tasks which support the children’s holistic development. 

Cognitive-emotional music listening starts from the assumption that a music piece will be more 
permanently adopted if children experience and live through it in multiple modalities, and associate 
everything with their own viewpoints and beliefs. If a musical piece is brought closer to students in a way 
appropriate for them, with musical and extra-musical stimuli and with their own activity and expression, 
it will allow easier and faster learning, better understanding and longer-lasting memory, as well as the 
emotional reception of the music (Dunn, 2008; 2014; Fung and Gromko, 2001; Johnson, 2013). 

Another characteristic of the cognitive-emotional music listening is that the same piece is listened 
to through three levels during a single class, integrally or fragmentarily, depending on its duration. 
The first listening is exclusively experiential, spontaneous, focused on the emotional reception of the 
composition and is not guided by specific questions of cognitive type. The middle level of music listening 
is cognitively oriented, though the emotional context deepens due to the activity that proceeds in parallel 
to music listening. It is due to the multimodal listening which is characteristic for the second level of 
music listening that the emotional context is enhanced since students’ activity as well as motivation are 
at a high level. The final listening is not determined in advanced by questions about musical-expressive 
components. The piece is listened to as a whole. In this stage, cognitive and emotional aspects are united, 
with the assumption that the experience can be conditioned by a better knowledge of the piece and its 
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acceptance. In the final listening, which can be relaxing, students shape their impressions of the piece, 
express their emotions, show the level of knowledge and analytic skills. Repeated listening to a musical 
piece or its excerpts, observation and familiarization with the piece from different perspectives, as well as 
the discussion about the piece and the experience after listening make it possible to better understand the 
piece and its specifics and — we assume -— leads to its acceptance. 

since the essential idea of the described models, concepts and approaches is to promote classical 
music in schools, it is the school of music that should be the right place where music should be presented 
by means of listening. Having in mind the structure of classes in schools of music, ear training classes 
should be the most appropriate for this purpose. However, it is not happening, nor are such possibilities 
considered. Can reasons for this be found in the overburden of ear training classes with the existing 
contents, teachers’ inertness or something else, are questions that could be specifically answered by 
research in the area of professional music education. 


Music listening in the context of ear training classes 


Music listening by means of reproduction devices as the youngest form of work in music teaching was 
introduced in the teaching practice of primary general education schools in the subject music education/ 
training/culture, according to amendments to curricula. Since its introduction, this area was understood 
as a form of the modernization of music teaching in primary general education schools, and it enriched 
teachers’ work. Learning about the elements of the history of music was less dull if teachers were able to 
present a couple of audio recordings, and it was exciting for students as well, since at the time many of 
them did not have the opportunity to listen to music on tapes or records outside the classroom. 

In this respect, it can be observed that teaching technology was not used in schools of music until the 
most recent time, and that therefore ear training classes remained cloaked in traditionalism. We presume 
that there are several possible reasons for the inertness of music teachers and music pedagogues with 
respect to modernizing ear training classes by means of introducing new teaching technologies. One of 
the reasons can certainly involve the very structure of classes, since ear training classes are delivered 
in a group, as opposed to individual instrument classes. Indeed, from the present perspective, several 
centuries had to pass from the first organized music teaching in church and guild schools, through classes 
at conservatories, private lessons, to a form of professional music education such as a structured school 
of music of the 19" century. Even then, music classes typically implied teaching playing or singing. 

Ear training classes were inaugurated as a course in the curriculum of Paris Conservatory in 1795 
(Kazi¢, 2013), and in the 19" century, this model of music teaching was accepted across both France 
and Europe. Besides major courses, almost all the conservatories of the 19" century had classes in ear 
training, harmony, counterpoint, sight reading etc. In this respect, ear training classes rounded out their 
physiognomy relatively fast. Their aims included gaining music literacy and learning elementary theory of 
music, analytic approach (audible and visual) to interval, triad etc. then sight-singing, rhythm processing, 
recording musical dictation, possibly learning songs regardless of different didactical viewpoints and 
solutions. Although the 19" and the 20" century were certainly fraught with a multitude of didactical 
ideas, procedures, concepts, manuals, textbooks, collections of examples etc., the basic elements of ear 
training classes have remained almost the same to this day, which is evident in reviewing recent curricula. 
Besides, some ear training textbooks of the 19" century written by music pedagogues of French tradition, 
e.g. Panseron, Lavignac, English pedagogues from Curwen’s Tonic Sol-fa College, German editions by 
Hundoegger Tonika-Do-Verlag of the early 20" century can even today be successfully used and are 
somewhere used in ear training classes. 

With respect to the elements of in-class music listening (if an instrument was available), these could 
be only the elementary melodic or rhythmic structures which were focused on recording musical dictation, 
audible perception of an interval, melodic and rhythm structures. Therefore, one cannot describe it as a 
well-conceived cognitive approach. Such music listening served as an aid for doing assignments, rather 
than being aimed at truly getting closer to the essence of music by means of sensory cognition. No 
emotion was involved since the assignments of the musical dictation type or analytic identification of 
given structures were entirely of ontological nature. The previously cited German ontologist Herbart dealt 
with the issues of form in arts which, according to him, is the entirety of all relations that, for instance, 
in a musical structure comprises of notes, perhaps rhythm, etc. Its aesthetic value is not subject to a 
subjective assessment, and therefore to emotion, since aesthetic depends on the relations between 
content elements which are, in this case, as they are; thus, in their own right. Which relation provides 
an aesthetic moment, which is good and which is not, is the subject of aesthetics, which in this stage of 
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education is not necessary. As was already pointed out, it was mostly the ontological moment ear training 
classes (Kazic, 2019). 

Besides the fact that, in the 19" and the first half of the 20" century, ear training was rounded out 
in terms of the forms of work, in a way, it closed for possible new approaches and solutions. It was the 
time of the search for didactical procedures and means, a time of great pedagogical ideas, though also 
of the focus and system, i. €. a road to technicism (Kazic, 2019). The rationalist use of what had already 
been tested would provide more modest though perhaps the expected outcomes in teaching music, in the 
sense that the sheet music is sung as soon and as correctly as possible, or that the musical dictation is 
recorded as soon and as accurately as possible. It is evident in the numerous textbooks and manuals of 
the time, whose very titles reveal their authors’ megalomaniac aspiration to solve such a complex subject 
matter of ear training exclusively by means of a system of their own exercises (e.g., from French literature, 
1600 Exercices Gradues, Cours Complet d’Education Musicale, Cours Complet de Solfege, etc.) 

At the time when technological conditions were created for listening to musical examples in the 
class, ear training classes simply did not allow any space for this activity, or for the idea to possibly 
incorporate music listening in some of the existing procedures and thus increase the supply. Thus, music 
listening as a potentially valuable form of work remained exclusively in music classes in general education 
schools. 

In a memorable didactical approach, different from previous ones, Basic (see Letica, 2014) 
considers music listening as an essential need in the development of aesthetic sensibility. Music listening 
is syncretically linked to visual expression, which in the most natural way sensitizes and releases 
emotionality. In this case, music listening activates children’s syncretic expression as a form of the unity 
of motor, speech and musical/musicality elements (Kazic, 2019). The class usually starts with the music of 
atmosphere or movement, a major or minor mood, as well as possibly with more complex palettes of the 
offered sound of a musical phenomenon that the teacher performs on the piano. Thus, it is not listening 
to the integral piece on a phonograph record, though it is also a way to foster attention and experience. 
The cognitive component is also used as a feedback, since monitoring children’s responses to the musical 
woof provides knowledge of their actual abilities, which makes it possible to use children’s dispositions in 
the further development of their artistic, i.e. aesthetic upbringing. 

Didactical manuals for ear training (Grgosevic, Kazic, Radiceva, Rojko, Vasiljevic) do not consider 
listening to music examples by means of reproduction devices in any segment. Kazic (2013, 2019) 
proposes the audio recording as a possibility for work on musical dictations; however, in these instances 
attention is focused only on the assignment rather than on the well-conceived listening and musical 
experience of the emotional component of the piece. Neither do the manuals such as 222, 555 izabranih 
tema za solfeggio [222, 555 selected themes for ear training] (Markovic) or even 999 glazbenih tema iz 
glazbene literature za solfeggio [999 musical themes from musical literature for ear training] (Golcic) open 
the way for gradual understanding and experiencing a work of art since these are short themes taken 
out of the context of a whole, or short excerpts from great orchestral forms that are notated monophonic. 
such examples can certainly be used for sight singing or playing, or for dictations, but — at this level - they 
can hardly be experienced and viewed in the context of the entirety of a musical piece. Although Popovic 
suggests that, after singing an example from art music literature in his textbook students hear the entire 
piece from a phonograph record, the appropriateness of such an approach is debatable. Students are 
unlikely to find their way and recognize the previously sung theme in the entire sound by listening to the 
performance of a symphony orchestra. 

Certainly, the context of ear training classes does not recognize integral or partial listening to a 
musical piece as a potential didactical procedure or a possibility to incorporate it as such in another, 
already existing procedure. This could perhaps confirm the significance of the emotional component in 
ear training classes, since all modern approaches unambiguously point to the need for synergy between 
cognitive and emotional in art teaching. 


Prospects of cognitive-emotional music listening in ear training classes in the 
primary music school 


Cognitive-emotional music listening has certainly opened the possibility to incorporate this way of 
listening in other areas, such as ear training. Since the listening is aimed at shaping students’ cultural- 
artistic worldview and at contributing to their aesthetic upbringing, its task is to develop and improve 
students’ musical competences, and the objective is to experience, understand and accept art music, 
the described postulates can be mapped to the area of ear training as well. The possibility of achieving 
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the goal is even greater in the music school, since classical music is the focus of work in students’ music 
education, and the number of hours is greater than that of music classes in the general education school. 
Focus on the cognitive and emotional dimension of music and learning, repeated listening, and multimodal 
and interdisciplinary approach to a musical piece can be achieved in ear training classes, where it is also 
possible to foster a humanistic paradigm that leads to students’ holistic upbringing and education. 

Repeated listening in ear training classes, as well as in music classes in the general school proceeds 
in stages, and we therefore recognize further similarities in cognitive-emotional music listening between 
different subjects. The initial listening is emotional and supports the experience of the whole without 
announcements and stimuli. It is spontaneous and Is followed by a discussion about impressions. The 
middle listening is of cognitive and emotional types. Students are motivated and guided by musical and 
extra-musical stimuli to experience a musical piece more intensely and get familiar with it. The listening is 
multimodal, and students participate actively. The final listening, which also sums up the subject matter, 
is of cognitive-emotional character and spontaneous. The teacher probes the overall impression and 
encourages various ways of students’ expression. Besides learning about the musical-historical context 
of the emergence of the piece at a given time and space, composing procedure and theoretical and 
harmonic features of the piece, students develop their musical/musicality thinking, are encouraged to 
think critically and evaluate the music, as well as to discover and self-realize their own selves. 

Together with the described features of the approach, which can be used when delivering teaching 
units in both general and music school, attention should be paid to the fact that the cognitive approach 
to listening in the music school is more complex due to the scope of musical knowledge and skills that 
students should gain in ear training classes. It is for this reason that preparations for work in ear training 
classes in the primary music school should be based on laws and contents of ear training, although they 
will be dealt with in a somewhat different way by means of cognitive-emotional listening. When developing 
the cognitive-emotional listening lesson plans, it is important for teachers to be guided by criteria such 
as appropriateness for the students’ age, as well as the compliance with the curriculum, and to pay a 
particular attention to studying the musical piece and discovering the message it brings. In this way, the 
musical piece will become and remain impressive for students and will influence their development, both 
as musicians and as humane and emphatic persons. 

since research findings of a comprehensive study on the cognitive-emotional music listening have 
been published in several stages in papers by Vidulin, Plavsic, and Zauhar (2019, 2020), Vidulin and 
Plavsic (2020), and Vidulin (2020), advantages of the cognitive-emotional approach compared to the 
Standard approach to music listening have been confirmed. In the multimodal approach supported by 
musical and extra-musical activities, increased interaction and active participation, students were more 
focused on the musical piece and expressed the desire to listen to it again. Their cognitive and emotional 
experience helped them to generate a larger number of responses of a broader spectrum which pertained 
to the cognitive elements, ¢.g. recognition of musical components, and to emotional elements, e.g. 
associations to the piece and identification of emotions, as well as the experience of the music. The 
findings also indicate that the teacher's guidance and the level of students’ (inter)activity during the class 
are decisive for their experience of music listening. 

Although the value of the cognitive-emotional music listening has been recognized and proven 
by research in the primary general education school, many questions remain open. In this respect, 
answers are expected that will improve the professional music education and provide guidelines related 
to the role, function and significance of music listening in ear training classes and that pertain to musical 
dictation, sight-singing, mastering melodic and rhythmic structures, and theory of music. Besides, it will be 
important to determine guidelines pertaining to the detection of the psychological processes that support 
the cognitive-emotional music listening in ear training classes, skills and competences allowed by the 
approach, way of delivering classes and expected outcomes. 

Research of the cognitive-emotional music listening in ear training classes will be guided by 
research findings pertaining to the primary music school, though respecting the specifics of the course 
in ear training. It is important to find the optimum multimodal interactive methods that will help students 
to understand, analyse, try out, experience, memorize and accept the piece they listen to, as well as to 
discover their own selves, enrich their personal and emotional experience. 


Conclusions 


Tracking the historical course of didactical initiatives in the area of ear training reveals the tendency 
to use primarily the audible perception of musical concepts; however, the practical implementation was 
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a rarity until the emergence of technical devices. Conscious music listening with the audible perception 
found its place in the mid-20" century and has, to this day, mostly been based on intellectual and rational 
reflections, without expressing the emotional and aesthetic component. Although there are exceptions 
which point to the association between music listening and rhythmical movement or visual-art expression, 
and although some music pedagogues also propose the continuous listening, the active and guided music 
listening and expressing impressions and the emotional experience, focusing attention on the expressive 
musical components still prevails. The emotional approach to music listening that can be detected in the 
history of ear training as a formulation or aspiration has not been associated with listening to an actual 
musical piece, or the listening was linked to a specific assignment. 

If music listening is viewed as a possibility that results in an experience, perception, emotion, 
analysis, cognition, opinion, aesthetic judgment etc., it is apparent that it requires a change in the listening 
strategy, as well as in its goal. The cognitive characteristics are still important part of learning about 
music, and therefore giving assignments before music listening can still be considered a good didactical 
procedure, which motivates students to actively follow, listen and analyse music. However, besides the 
well-conceived assignments that lead to the cognitive dimension of music listening, it is important to 
emotionally involve students in music listening and to encourage discussion of emotional experiences, 
states and associations resulting trom the listening. 

Though primarily music-oriented, music listening in ear training classes can also be observed in its 
relationship with other musical and extra-musical areas and activities, in the multimodal and interdisciplinary 
way. Classical music, which is the foundation of work in the school of music, is experienced and studied 
mostly by means of musical activities: by singing, playing, listening, all of which influence the development 
of students’ musical knowledge and skills. However, the cognitive-emotional listening deepens this 
development. Music listening can be incorporated in some of the already existing procedures, music can 
be listened to repeatedly, integrally or partially, and the expected outcome will encompass both learning 
about musical phenomena, i.e. better understanding of music, and experiencing and identifying the 
emotions transferred by the music and states that the listener is in. 

Developing lesson plans based on the cognitive-emotional listening, its research in practice and 
testing its success, all aimed at correcting the objective and tasks of music listening in the music school 
could be a polygon for modernizing ear training classes. Repeated listening to a musical piece or its 
excerpt, observing and learning about the piece from different perspectives and discussion of the piece 
and experience make it possible to better understand the piece and its specifics. A shift away from musical 
literacy, sight-singing and learning the theory of music, together with musical dictation, audible perception 
of intervals, chords or a rhythmic structure, which are the end in themselves, toward the cognitive- 
emotional listening will allow students’ development both as musicians and as humane members of social 
community. By making music, learning, developing skills and expressing their personal viewpoints, beliefs 
and emotions and accepting others’ positions, they will get to know and learn to respect both themselves 
and others. 
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grammatical or spelling errors and to conform to correct scientific English may wish to use the English 
Language Editing service available from EDANZ - 

http:/Awww.edanzediting.com/services/english_editing 


NEW SUBMISSIONS 

Manuscripts must submit only online, proceeds are totally online and you will be guided stepwise 
through the creation and uploading of your files. Electronic submission reduces the editorial processing 
and reviewing times and reduces the time of submission to publication. 

You have to use IJCRSEE template to prepare your article and this version upload via 

http://ijcrsee.com/index.php/ijcrsee/about/submissions#onlineSubmissions 


Formatting requirements 

The prepared article should be formatted with INCRSEE template. There are some parameters for 
authors. 

lf your article includes any Videos and/or other Supplementary material, this should be included in 
your initial submission for peer review purposes. 

Divide the article into clearly defined sections. 

Structure of Manuscripts 

Title Page 

The title page should include: 

The name(s) of the author(s) 

A concise and informative title 

The affiliation(s) and address(es) of the author(s) 

The e-mail address of the corresponding author. 

Abstract 

The abstract should contain a maximum of 250 words. The abstracts should avoid any abbreviations 
and mathematical formulas. 

Keywords should include 4-6 keywords. 

Text Formatting 

Manuscripts should be submitted in Word, A4, Arial Narrow, 10-point for abstract and keywords and 
12-points for text. 


A complete manuscript falls need to be maximum 8,000 words excluding references, tables, and 
figures. Depending on the research and work purposes, the editor decides the acceptance of a larger 
number of pages. 

For numerations of pages use the automatic page numbering function. 

In the text for emphasis use italics. 

The use of abbreviations should be avoided. If using the first Abbreviations should be used 
throughout the text the same. 

For headings use maximum three levels. 

Footnotes should be avoided. If used, footnotes should only contain additional text (comment), and 
not information about sources used. 

Acknowledgments should be placed in a separate section before the reference list. 

Introduction — State the objectives of the work and provide an adequate background, avoiding a 
detailed literature survey or a summary of the results. 

Materials and Methods — Provide sufficient detail to allow the work to be reproduced. Methods 
already published should be indicated by a reference: only relevant modifications should be described. 

Results — Results should be clear and concise. 

Discussions — This should explore the significance of the results of the work, not repeat them. A 
combined Results and Discussion section is often appropriate. Avoid extensive citations and discussion 
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of published literature. 

Conclusions - The main conclusions of the study may be presented in a short Conclusions section, 
which may stand alone or form a subsection of a Discussion or Results and Discussion section. 

Appendices - If there is more than one appendix, they should be identified as A, B, etc. Formulae 
and equations in appendices should be given separate numbering: Eq. (A.1), Eq. (A.2), etc.; in a 
subsequent appendix, Eq. (B.1) and so on. Similarly for tables and figures: Table A.1; Fig. A.1, etc. 

Acknowledgments - Collate acknowledgments in a separate section at the end of the article 
before the references and do not, therefore, include them on the title page, as a footnote to the title or 
otherwise. List here those individuals who provided help during the research (e.g., providing language 
help, writing assistance or proofreading the article, etc.). 

Reference Style -— All manuscripts should be formatted using the American Psychological 
Association (APA) citation style, which is used primarily in the social sciences. For additional examples, 
consult the most recent edition of the Publication Manual of the American Psychological Association. Use 
of DOI is highly encouraged. 


CITING REFERENCES IN TEXT 
Please ensure that every reference cited in the text is also present in the reference list (and vice 
versa). Any references cited in the abstract must be given in full. Citation of a reference as ‘in press’ 
implies that the item has been accepted for publication. 
¢ If an one author is sufficient to cite only the year, but not the page if you do not quote the text 
directly, or do not mention the fact that needs to be linked to the page. 
Busk (2014) compared reaction times ... 
In a recent study of reaction times (Busk, 2014) ... (ibid, str.105). 
When citing in plain text, the author's name and year of release of work separated by commas. 


If we are in the plain text provide the name and year of the author, there is no need to give the same 
information again in parentheses. 


In 2012 Stosic compared reaction times ... (ibid, page 102). 


¢ When a work has two authors, always indicate both names and year and between surnames of 
the authors specify the conjunction &. 


Nightlinger and Littlewood (2003) demonstrated ... 
As has been shown (Busk & Serlin, 1993) ... 


¢ When in plain text quoting the names of three, four or five authors, first make sure to include all 
the names, and text enough to write only the first and add ° and associates”. 


First time: Yan, G., Tian, H., Bai, X. & Rayner, K. (2006). found ... 
second time: Yan, G.et al. (2006) found ... (ibid, p. 12) 


¢ When a work has no author's name, whether it's because it is issued by the agency, organization, 
or governmental institutions, rather than the names of authors mention the name of the institution or 
organization that has signed the paper, and if a name is long, just so many words or abbreviation as 
needed to locate the source in the list of references. 


First time: (National Institute of Mental Health [NIMH], 1999) ... 
second time: (NIMH, 1999) ... 


¢ When you do not have the names of institutions or authors, when the work is anonymous, then 
mention only the first few words of the title, and we quote them in parentheses under the quotation marks 
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in plain text in italics. 
These result present (° Study Finds, ” 2002) ... 
The book College Bound Seniors (2003) ... 


When work in the header nominated as anonymous, then it in the text under the anonymous quote 
and cite year, in English (Anonymous, 2011). 


¢ If there are two references to the same author’s last name, then be sure to mention when citing 
the initials to avoid unnecessary search in a list of references. 


JM Goldberg and Neff (1961) and ME Goldberg and Wurtz (1972) studied ... 


¢ lf the same author or the same authors cite two or more references, then in brackets do not repeat 
names but just add a year for the next release. 


Past research (Edeline & Weinberger, 1991, 1993) ... 
Past research (Gogel, 1984, 1990) ... 


«When the same author we have more work during one year, then these sources labeled the letters 
of the alphabet a, b, c and so on. 


several studies (Gogel, 1984, 1990a, 1990b) ... 


¢ When several authors cite in the same bracket, or when we point to the consent of the author, 
references detach semicolon and listed them in alphabetical order. 


several studies (Balda 1980, Kamil 1988, Pepperberg & Funk, 1990) ... 


¢ If with some of the references cite a source that confirms what is specific to this reference, then 
the source listed below see also, but that goes with the source of reference, but not alphabetically. 


several studies (Minor 2001; see also Adams, 1999; Storandt, 1997) ... 

¢ When quoting hearsay, cite the author's name and year of the original work, followed by a 
semicolon and then cited code, then last name, year and foreign labor from which he quoted original work. 

The first definition of intrinsic motivation gave Decy (1975; see Suzic 2005, p. 108) ... 


¢ If we know the year of the first publication of the work, then it is to be connected age translation 
by first listed year of first publication, a slash and then year translation. 


(James, 1890/1983) 


¢ For an Internet source that does not have a bookmarked Web page, use a pair of J and paragraph 
number on the page where it was published. 


(Myers, 2000, 5) 


¢ Personal communication or publicly spoken words in a lecture to quote only in plain text, but not 
in the list of references, but does mention the date of actual communication. 


Decy (personal communication, April 18, 2001) ... 
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REFERENCES 
¢ Form Guidance papers in the journal is as follows: 


The author’s name [comma], initial / names [point], [open small brackets] year of publication [close 
little brackets] [point] title of the paper [point], the name of the magazine - in italics [comma] the number 
or volume - in italics [comma | page starting work [line] Page completing work [point]. 


Dennis, TA, Cole, PM, Wiggins, CN, Cohen, LH & Zalewsky, M. (2009). The functional organization 
of preschool-age children’s emotion expressions and actions in challenging situations. Emotion, 9, 
920-530. 


¢ Form quoting the works of authors of books is as follows: 


The author’s name [comma], initial / names [point], [open small brackets] year of publication [close 
little brackets] [point] title deeds - in italics [point], the city (and state) [two counts], the publisher [Point ]. 


Hirsch, Jr., E. D. (1996). The schools we need and why we do not have them. New York: Doubleday. 


¢ When you mention a paper published in a journal or as part of a book as a chapter, then applies 
the following form: 


The author’s name [comma], initial / names [point], [open small brackets] year of publication [close 
little brackets] [point] title of the paper [point], In Proceedings ... (note that the work was published in a 
journal or book ...) The name of the publisher [open small brackets] Issue. (Note that this is a publisher) 
[Close little brackets] [comma] title of the collection - in italics [open small brackets] page starting work 
[line] Page completing work [point], the city (and state) [two counts], publisher [point]. 


Barrett, KC, & Campos, JJ (1987). Perspectives on emotional development: II. A functionalist 
approaches to emotions. In Osofsky JD (Ed.), Handbook of Infant Development (2° ed., Pp. 555-578). 
Oxford, England: Wiley. 


¢ If seven or more authors, then we will list the names of the six authors, and the seventh and the 
rest fall into the category of ° and associates ”. 

Adam, JJ, Paas, F. Teeken, JC van Loon, EM, Van Boxtel, MPJ, Houx, Pu, et al. (1998). Effects of 
age on performance and a finger-precuing task. Journal of Experimental Psychology: Human Perception 
and Performance, 24, pp. 870-883. 


second and last author in a list of references are always stating afterward conjunctions & English. 

¢ ln magazines published articles cite the following form: 

the author's name [comma], initial / names [point], [open small brackets] day, month and year of 
publication [close little brackets] and the title [point], the name of the magazine or newspaper - italics 
[comma], number of journals or Newspapers - italics [comma], page beginning of the text [line] Page 
completing the text [point]. 

Henry, W.A., III. (1990, April 9). Beyond the Melting Pot. Time, 135, 28-31. 

¢ When we need to with the title of the article mention what kind of material it is then enclosed in 
square brackets after the title of the paper is printed by it is a brochure, video recording and the like. 

Research and Training Center on Independent Living. (1993). Guidelines for reporting and writing 
about people with disabilities (4" ed.) [Brochure]. Lawrence, KS: Author. 

¢ The work of famous authors downloaded electronically applies the following form: 


The author’s name [comma], initial / names [point], [open small brackets] year of publication [close 
little brackets] [point] title of the paper [point], an indication of what kind of material is in square brackets, 
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taken (note that work will take) the day, month and year, with (internet address). 


schwarzer, R. (1989). Statistics software for meta-analysis [Computer software and manual]. 
Retrieved March 23, 2001, htto://www.yorku.ca/faculty/academic/schwarze/meta_e.htm 


«When the list reference is made to the work that is being prepared for the press, after the authors’ 
names, in parentheses, listed in the press in English. 


Zuckerman, M. Kieffer, SC (in press). Race differences in faceism: Does facial prominence imply 
dominance? Journal of Personality and Social Psychology. 

¢ When the list of references cites a newspaper article without the author prints the name of the 
article, then the time of publication, then the title and number - in italics, and at the end of the page on 
which the article was published. If the title is long, we can shorten the optimum number of words by taking 
the first few words. 


The new health-care lexicon. (1983, August / September). Copy Editor, 4, 1-2. 


¢ If within the journal as publisher publishes a special issue as a monograph, It is necessary after 
heading indicate that it is a monograph. 


Ganster, DC, Schaubroeck, J. Sime, WE, & Myers, BT (1991). The nomological validity of the Type 
A personality among employed adults [Monograph]. Journal of Applied Psychology, 76, 143-168. 


¢ When an abstract or summary of the quote as the original source, after the title should be in 
parentheses to indicate that it is abstract. 


Woolf, NJ, Young, SL, Famselow, MS, & Butcher, LL (1991). Map-2 expression in cholinoceptive 
pyramidal cells of rodent cortex and hippocampus Is altered by Pavlovian conditioning [Abstract]. Society 
for Neuroscience Abstracts, 17, 480 harvesters. 


¢ Titles that are not in English, and we want them to be published in the journal in English, listed in 
their native language, and then in the square brackets give the title translation into English. In addition to 
the title, everything else remains the mother tongue. 


Ising, M. (2000). Intensitatsabhangigkeit evozierter Potenzial their EEG: Sindh impulsive persons 
Augmenter stage Reducer? [Intensuty dependence and event related EEG potentials: Are impulsive 
individuals augmenters or reducers?]. Zeitschrift fur Differentiel und diagnostisch Psychology, 21, 208-217. 


¢ In the list of literature translated work following a text that we have a year of the original edition 
listed in parentheses at the end behind the publisher. When we quote in plain text, year of first publication 
and translation writing along with a slash between (eg. Laplace, 1814/1951). 


Laplace, P. S. (1951). A philosophical essay on probabilities (FW Troscott & FL Emory, Trans.). New 
York: Dover. (Original work published 1814) 


«When the list of references cites a paper published in the Proceedings of the translated, italics will 
print the name of the collection at the end to add when it published the original. 


Freud, S. (1961). The ego and the id. In J. Strachey (Ed. & Trans.), The standard edition of the 
complete psychological works of Sigmund Freud (Vol. 19, pp. 3-66). London: Hogarth Press. (Original 
work published 1923). 


¢ When you cite articles published on the university or one of the official institutions, universities, 
publishers listed as the first name of the university and then university. 


Broadhurst, RG, & Maller, RA (1991). Sex offending and recidivism (Tech. Rep. No. 3). Nedlands: 
University of Western Australia, Crime Research Center. 
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«When the list of sources cites a report of an organization or institution that has no author, it is best 
to nominate as the author of this organization, which is also the publisher. 


Employee Benefit Research Institute. (1992, February). Sources of health insurance and 
characteristics of the uninsured (Issue Brief No. 123). Washington, DC: Author. 


¢ When the work was published on the Internet as a photocopy, it should cite the original source 
noting that this is the electronic version. 

Vandenbos, G. Knapp, S., & Doe, J. (2001). The role of reference elements in the selection of 
resources by psychology undergraduates [Electronic version]. Journal of Bibliographic Research, 5, 
117-123. 


¢ If you download from the Internet work that you believe Is different from the original, do not copy 
or no numbered pages, then at the end indicate the date of downloads and web address. 


Vandenbos, G. Knapp, S., & Doe, J. (2001). The role of reference elements in the selection of 
resources by psychology undergraduates [Electronic version]. Journal of Bibliographic Research, 5, 117- 
123. Retrieved October 13, 2001, from http://jbr.org/articles.htm| 


¢ When you download from the Internet a document which has no date or author, then the document 
name takes the place of the author or the first place. 

8th GVU's WWW User Survey. (Od). Retrieved August 8, 2000, from http://www.cc.gatech.edu/ 
gvu/user_surveys/survey-1997-10/ 


¢ Material from the symposium or a scientific paper which was only exposed, but not published, 
listed with the note on which the scientific or professional meeting is material exposed. If the author has 
presented on the site, it is desirable to name and web page. 


Cuter, LD, Frolich, B., & Hanrahan, P. (1997, January 16). Twohanded direct manipulation on the 
responsive workbench. Paper presented at the 1997 Symposium on Interactive 3D Graphics. Abstract 
retrieved June 12, 2000, from http://www.graphics.standard.edu/papers/twohanded/ 


¢ Computer software listed noting computer software. Name of the software we write italics. 


Miller, M. E. (1993). The Interactive Tester (Version 4.0) [Computer software]. Weastminster, CA: 
Psytek Sesvice. 


¢ Data downloaded from the website of the government or other official organization listed noting 
data file. The filename of the data listed in italics. 


Department of Health and Human Services, National Center for Health Statistics. (1991). National 
Health Provider Inventory: Home health agencies and hospices, 1991. [Data file]. Available from the 
National Technical Information Service Web site, htto://www.ntis.gov 


standards take according to Suzic, N. (2010). Pravila pisanja naucnog rada APA | drugi standard 
[Rules scientific APA work and other standards]. XBS Banja Luka. 


Reference management software 

The journal has a standard template — IJCRSEE template. To cite reference, it is the easiest way to 
use Some management software like: 

Mendeley (http://www.mendeley.com/features/reference-manager) 

EndNote (http://www.endnote.com/support/enstyles.asp) and 

Reference Manager (http://refman.com/support/rmstyles.asp). 

Above management software have plug-ins to word processing where authors only need to select 
the appropriate journal template when preparing their article and the list of references and citations to 
these will be formatted according to the journal style as described in this Guide. If you cannot find an 
available template, see the list of sample references and citations provided in this Guide to help you 
format these according to the journal style. 
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After acceptance 

Online proof correction 

Corresponding authors will receive an e-mail with a link to our online proofing system, where have 
to make prof own article. The final version is created in PDF and authors have to accept final version or 
to immediately report the error. We will do everything possible to get your article published quickly and 
accurately. Please check carefully before replying, as the inclusion of any subsequent corrections cannot 
be guaranteed. Proofreading is solely your responsibility. 

httos://oubpeer.com/Check the comments on published and withdrawn works. 


All the articles in this journal have been peer reviewed. Nonetheless, editors and organizers are not 
responsible for the content shown in this publication. 


Submission Preparation Checklist 

As part of the submission process, authors are required to check off their submission’s compliance 
with all of the following items, and submissions may be returned to authors that do not adhere to these 
guidelines. 


The submission has not been previously published, nor is it before another journal for consideration 
(or an explanation has been provided in Comments to the Editor). 

The submission file is in OpenOffice, Microsoft Word, RTF, or WordPerfect document file format. 

Where available, URLs for the references have been provided. 

The text is single-spaced; uses a 12-point font; employs italics, rather than underlining (except 
with URL addresses); and all illustrations, figures, and tables are placed within the text at the appropriate 
points, rather than at the end. 

The text adheres to the stylistic and bibliographic requirements outlined in the Author Guidelines, 
which is found in About the Journal. 

If submitting to a peer-reviewed section of the journal, the instructions in Ensuring a Blind Review 
have been followed. 

Have checked paper for possible accidental plagiarism. Some plagiarism checker websites includes: 
http://www. ithenticate.com, www.grammarly.com,www.plagtracker.com, or www.duplichecker.com 

To verify originality, your article may be checked by the originality detection service CrossCheck. 
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